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Introduction 


California has instituted far-reaching reforms of its TK—12 schooling system designed to 
advance equity and strengthen teaching and learning. New standards—the Common Core State 
Standards and Next Generation Science Standards—and aligned assessments focus on critical 
thinking and problem solving. The redesigned system of financing schools provides increased 
resources for students with greater needs and significant autonomy for local communities over 
the allocation of state dollars. This has been accompanied by a new accountability system 
focused on broader definitions of student and school success, including student achievement, 
student engagement, parent and family involvement, and school climate. 


These advances create both new opportunities and new challenges for teachers and 
school and district leaders. Teachers need time, support, and resources to hone their practice 
to align with the new standards and broader definition of student success. School and district 
leaders must leverage the additional resources and autonomy to ensure that teachers have the 
supports they need to adapt their practice and improve student outcomes. 


And like teachers, in order to be effective in this environment of higher expectations for 
student learning, principals and superintendents need quality preparation and professional 
learning. Despite the importance of learning for education leaders, little is known about the 
preparation and development experiences of California’s superintendents and principals—that 
is, the learning opportunities they receive before taking a job as an administrator, and the on- 
the-job learning and professional learning opportunities they experience after they begin their 
job.’ For example: 


e What proportion of California principals and superintendents receive high-quality 
preparation and professional development? 

e Do California principals and superintendents ensure that professional learning 
opportunities focus on the needs of the whole child and on engaging students in deep 
learning? 

e What do California principals and superintendents identify as their greatest learning 
needs going forward? 

e How can local, state, and federal policies strengthen the quality and effectiveness of 
California’s principals and superintendents? 


To answer these questions, the Learning Policy Institute conducted a study of leadership 
in the state with the assistance of the Association of California School Administrators (ACSA) 
and the American Institutes of Research. We administered a representative survey to more 
than 450 California principals; analyzed the most recent federal data about school leaders in 
California and across the nation; reviewed available California data; and conducted focus 
groups and interviews with principals, former principals, and superintendents from across the 
state. (See Appendix A for details about the methodology used for this study.) 
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In this report, we 

e provide an overview of California’s leadership context; 

e describe the kinds of principal preparation and professional development available in 
the state; 

e report on how principals assess their leadership preparation in light of the new 
educational demands of deeper learning and social- emotional learning; 

e summarize the learning opportunities principals report they want; 

e describe superintendents’ experiences with professional learning; and 

e conclude with policy implications informed by our findings. 


Overall, we find that California’s education leaders experience elements of high-quality 
preparation and professional development, especially principals who have more recently 
completed preparation programs. However, those learning opportunities are piecemeal and 
often do not include the most valuable elements of quality learning experiences. Limited access 
to these key professional development activities is particularly an issue for principals serving in 
rural areas. California principals do not consistently participate in professional learning 
opportunities that support them in leading schools that develop students’ deeper learning and 
social and emotional competencies. California’s principals and superintendents want more of 
this kind of professional development—especially those principals in schools serving higher 
proportions of students from low-income families and students of color. 


Why Invest in Education Leaders? 


High-Quality Principals and Superintendents Support Student Achievement 


Study after study has found that the quality of school leaders is associated with gains in 
student achievement, including standardized test scores” and graduation rates,* even when 
controlling for student and school characteristics.* To measure the effect of principals, 
researchers generally look at schoolwide student standardized test score gains and control for 
the multiple inputs into student achievement, such as school, student, teacher, and time 
factors. Other studies define quality by using surveys of teachers, parents, staff, and principals 
to identify the leadership characteristics associated with principals in schools that have larger 
gains in student achievement.° 


In addition, principals who remain in their schools for longer periods of time are 
associated with improved schoolwide student achievement. Conversely, principal turnover is 
associated with lower gains in student achievement,’ which has a more significant negative 
effect in high-poverty, low-achieving schools—the schools in which students most rely on 
education for their future success.® The negative effect of principal turnover suggests that high 
levels of churn are disruptive and that principals need time to make meaningful improvements 
in their school.° 


Superintendents can also have a meaningful effect on raising student outcomes. To 
measure the effect of superintendents, researchers generally use the same approach that is 
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used to identify quality principals, as described above. The limited research on this topic 
generally finds that quality superintendents positively influence student achievement. *° 
Superintendents can also positively influence the school climate within their districts. For 
example, one study found that “having a higher-quality superintendent improves the safety 
climate in school by lowering the incidence of fights, increasing the safety of students, and 
lowering their anxiety about attending school.”** Similar to principals, superintendents who 
remain in their districts are generally associated with improved student achievement.” 


How leaders support student learning. Research finds that, across differing school and 
community contexts, principals associated with improved student and school outcomes 
positively influence schools by setting an overall direction with clear goals, leading instruction, 
redesigning the organization to support improved teaching and learning, and investing heavily 
in staff development. Effective superintendents share a similar set of attributes. In discussing 
the characteristics of effective principals, one California superintendent said: 


| want you to dig into data and know what to do with data. That’s so important. | want 
you to be able to be an employee manager. But | want you to be a learning leader, and 
that means you’re learning alongside [teachers], not telling them what to learn. 


Set direction. Effective principals who are associated with gains in student and school 
achievement set direction by establishing a vision for a strong learning environment that 
encourages teacher growth and retention” and drives a culture of continuous improvement.*> 
Such a vision is informed by data, empowers staff to share in school decision making, and 
inspires educators and students to focus on the core work of teaching and learning.*° 


Effective superintendents similarly set direction for their districts. These 
superintendents engage all education stakeholders—from principals to parents to the school 
board—to establish universal goals for their districts that all staff members commit to 
furthering. Effective superintendents also collaborate with education stakeholders to develop 
these goals around student achievement and classroom instruction, and work with their school 
boards to ensure that the boards are aligned with and supportive of the district goals. 
Additionally, superintendents monitor their district’s progress in meeting the goals. 1” 


Lead instruction. Effective principals and superintendents improve schools by focusing 
on improving instruction.”® Effective superintendents align district resources (e.g., time, money, 
and personnel) to accomplish the district’s instructional goals.*° Effective principals create 
structures and opportunities for teachers to critique, learn from, and collaborate with each 
other; analyze multiple forms of student data with the aim of improving instruction; and set 
high expectations for teachers and students.”° They also establish clear learning objectives, high 
expectations, and a focused learning environment. 


In the current California context, school and district leaders are key to supporting 
teachers in making the necessary instructional shifts for 21st century learning. Leaders need to 
rethink scheduling, resource allocation, staff and student assignments, and the time and 
support teachers and students need to learn. Given the broader definition of student and 
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school success within California’s new school accountability system, school and district leaders 
must also learn how to go beyond just students’ academic needs and support the “whole 
child,” including social and emotional development. Leaders do this by ensuring that instruction 
is engaging, that students can be healthy and safe in their classrooms, and that students feel 
connected to and rewarded by their learning. As one California principal described it: 


I’m responsible for not just educating the child, but for teaching them how to cope and 
be resilient and overcome traumatic experiences, so that then they can access the 
instructional academic needs or meet these accomplished academic goals so that they 
can escape poverty. 


Redesign organizations and develop people. Strong principals and superintendents 
redesign organizations by shaping the teaching and learning conditions that help all students 
learn and succeed, and by developing school staff. Redesigning organizations involves principals 
establishing class sizes, staff assignments, school climate and culture, and governance. 
Principals who leverage such redesign to improve student achievement and reduce teacher 
turnover further these efforts by ensuring that teachers have the necessary resources, 
communication channels, and funds to address the learning needs of all their students.” 


Principals and superintendents also develop people, in part through their influence on 
the quality of teachers that a school or district attracts and retains.”* Strong principals and 
superintendents strategically hire teachers and staff, provide regular and fair evaluations and 
feedback, and help their personnel to continually improve.*4 Quality leaders also focus on 
providing opportunities and resources for teachers and administrators to grow and become 
more effective.*° 


The ability of leaders to create organizations with positive working conditions and to 
develop a strong teaching staff is crucial because administrative support is one of the most 
important factors teachers cite in their decisions about whether to stay in a school or in the 
profession.”° Thus, principals and superintendents play a critical role in addressing California’s 
widespread shortages of teachers.”’ Leadership quality impacts teacher attrition even more in 
high-need schools.”° 


Why Is Leadership Critical to California’s Schools? 
Doing More With Less 


Quality preparation and development for principals and superintendents is especially 
important in California, where educational leaders face myriad challenges. California’s student 
population comes to school with great needs. California public schools educate 1.3 million 
English learners, which is more than 1 in 5 students in the state.” This is roughly equal to the 
combined number of English learners in the next three most populous states—Texas, Florida, 
and New York—even though these three states together have nearly twice as many students as 
California.°° California also has an increasing percentage of students from low-income families, 
with more than half (58.7%) qualifying for free and reduced-price meals—compared to an 
average of approximately 51.8% in the country as a whole. *? 


As one California principal said: 
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Students are coming to us now with many more challenges than they did before. ... 
There used to be the old adage of ... “You bus them in the morning, you feed them 
breakfast, you educate them, [you] feed them lunch.” We’re now also feeding them 
dinner. Now, we also have school programs ... an extended school year, this, that, and 
the other. ... It just keeps adding more as things go by ... because there are deficiencies 
in our society that the schools are expected to somehow pick up then miraculously 
change. And over the past 20 years, | just keep seeing that it just keeps adding more and 
more to that. 


Despite these high student needs, California’s educational leaders are working with less 
per-pupil funding than most other states. In 2015-16, California ranked 41st among all states in 
spending per k—-12 student (after adjusting for differences in the cost of living in each state). ” 
California schools also have fewer teachers, librarians, and guidance counselors per student 
than any other state. During the Great Recession, budget cuts forced schools to reduce the 
number of administrators, including assistant principals.** Between 2007-08 and 2011-12, 
there was a 19% reduction in administrators.** In 2011-12, California ranked 47th out of all 
states in the number of pupils per administrator.*° As the economy has recovered, districts are 
returning to pre-recession administrative staffing levels (see Figure 1). But even in 2016, 
California still ranked 47th in the nation in students per administrator. °° 


The relative lack of adequate resources and the high ratio of students to administrators 
is especially challenging in light of the new funding formula, which places greater responsibility 
for the use of funds on local leaders. The reform requires that each district create a Local 
Control and Accountability Plan (LCAP) in which the district outlines how it will allocate funding 
to support all students, from transitional kindergarten through high school. School and district 
leaders are expected to engage with educators, students, parents, and the broader community 
to develop their LCAP—a new responsibility on top of their normal duties. 
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Figure 1. Pupil-to-Administrator Ratios Are Decreasing Post-Recession but Still Rank Near Last 
Compared to Other States 
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Source: California Department of Education, annual CBEDs reporting available through Dataquest. 


California Has a Need for High-Quality Principals 


California does not have a shortage of individuals with the proper credentials to become 
principals, but many of them do not intend to do so, and many districts report not being able to 
find high-quality applicants who can meet the demands of the job in the current state context. 
In 2016-17, California issued more than 3,100 new administrative services credentials (see 
Figure 2).?” Of these, the vast majority (72%) are “certificates of eligibility,” meaning the 
individual is not employed as an administrator. Preliminary administrative credentials (28%) are 
issued to individuals who have offers of employment as administrators at the time they earn 
their credential. The California Commission on Teacher Credentialing (CTC) estimates that half 
of the individuals who earned certificates of eligibility in 2010-11 did not convert them to 
preliminary credentials within 5 years, meaning they never obtained employment as 
administrators. °° An administrative credential is required for most jobs in district and county 
educational offices, and a survey of individuals completing their Administrative Services 
Credential Program*? in 2016-17 reported that only 68% of individuals receiving a credential 
did so in order to get a position as a school administrator. Other reasons included wanting a 
district or county office position (33%), wanting a master’s degree (30%), and wanting to earn 
units for the salary schedule (18%).”° 
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Figure 2. Total Number of Certificates of Eligibility and Preliminary Administrative Services 


Credentials Issued—All Pathways, 2010-11 to 2016-17 


3,500 


3,000 


2,500 


2,000 


1,500 


1,000 


500 


2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17 


@ Certificate of Eligibility | Preliminary 


Note: Data include new credentials only; they do not include renewals. Data include new administrative 
credentials issued to individuals who came through the Commission-approved program pathway, exam pathway, 
and out-of-state prepared pathway. 

Source: Chart from Commission on Teacher Credentialing. (2016). Report of Services Credentials Issued in 
California, 2010-2011 to 2014-15. http://www.ctc.ca.gov/reports/services-cred-10-11-to-14-15.pdf. Additional 
data for 2015-16 and 2016-17 were provided to LPI by the CTC through a special request. 


Beyond the issue of quantity is that of quality. In a fall 2017 survey of 25 California 
school districts, nearly half of districts surveyed (45%) reported difficulty hiring principals due to 
an insufficient number of quality applicants.** (See Appendix A for more details on the 
superintendent focus groups.) These districts represent a combination of urban, suburban, and 
rural districts that together serve a quarter of the students in the state. In addition, every one 
of the 15 superintendents interviewed in our focus groups reported experiencing a shortage of 
quality school leaders in their districts. When referring to quality principals, the California 
superintendents we surveyed most frequently reported the following three qualities as the top 
qualities they look for when hiring principals: 


1. A focus on instructional leadership (93% of respondents) 
2. Emotional intelligence (66% of respondents) 


3. Aclear vision for improving a school (60% of respondents) 
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One California superintendent said, “I’ve hired a principal every year for the past 4 
years, and | probably have 30 to 50 applicants, but very few (are) really highly qualified.” 


Another superintendent said, 


The number of applicants that we’re seeing for principals, it has diminished significantly. 
... There are fewer applications to begin with, and then the number of qualified 
applicants within that pool are significantly lower. 


While the 2017 district survey and focus groups draw from nonrandom samples, the consistent 
results suggest that many districts are experiencing a shortage of quality school leaders. 


Principal Turnover and Inexperience Are Challenges for California 


Based on our analysis of California staffing data that includes the vast majority of 
principals in the state,“? we found that between 15% and 17% of principals left the profession 
or California after both the 2014—15 and 2015-16 school years (see Table 1). Moreover, 
another 7% of principals switched schools each year, meaning that nearly a quarter of California 
principals left their schools either because they left the profession or the state, or because they 
moved to become a principal in a different school. Compared to available evidence from other 
states, principal turnover in California is relatively high. For example, in other states with recent 
turnover data, such as Washington and Tennessee, only 20%” and 15%“ of principals turn over 
each year, respectively.” 


Table 1. California Principal Turnover 


2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 


Leavers — Principals who 


: 16.1% 14.0% 16.0% 16.4% 16.5% 15.3% 

left the profession or state 
M — Principals wh 

ican iia aac 10.1% 8.4% 9.3% 8.8% 7.3% 7.4% 
moved schools 

¢ Within-district movers 8.2% 6.4% 6.2% 6.1% 5.0% 5.4% 

¢ Between-district movers 1.9% 2.0% 3.0% 2.7% 2.3% 2.0% 
Total Turnover 26.1% 22.4% 25.3% 25.3% 23.8% 22.8% 
N 7,942 7,871 7,938 8,556 8,637 8,734 


Note: Calculations may vary due to rounding. 
Source: California Staffing Data File provided to LPI by the California Department of Education through a special 
request. 


California’s principals also tend to have less experience than those in many other states, 
with the modal (most common) principal in their first year at their current school accounting for 
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over 1 in 5 principals (see Figure 3).*°In California, the lowest achieving schools and schools 
serving a high proportion of students from low-income families and students of color are more 
likely to have an inexperienced principal than high achieving schools and schools with a low 
concentration of students from low-income families and students of color. For more 
information on the inequitable distribution of principals in California, see Grissom & Bartanen’s 
(2018) Getting Down to Facts II paper.*” 


Principals have become more mobile in the last decade. In 2004—05, the typical 
California principal had been the principal at their current school for almost 10 years, compared 
to only 4 years in 2016-17.*° The high rates of principal turnover and inexperience are 
concerning because it can take time for principals to make a meaningful improvement in their 
schools. For example, one study found that, on average, student achievement falls after a 
principal leaves a school and takes 5 years after a new principal is hired to fully rebound back to 
that level.” 


Figure 3. California Principal Experience, 2016-17 
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Source: Learning Policy Institute. (2017). Survey of California Principals. 


Superintendency is often referred to as “largely a short-term job.”°° A survey of more 
than 1,000 superintendents across the United States found that most had been in their current 
position for between 1 and 5 years.> One study of 215 California superintendents found that 
45% left their position after 3 years.°* In our analysis of California staffing data that includes the 
majority of superintendents in the state,°® we found similarly high superintendent turnover 
rates (see Table 2). Approximately 21% of superintendents left the profession or the state after 
the 2014-15 school year, and 13% left after the 2015-16 school year. Moreover, another 3% to 
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5% of superintendents switched districts each year, meaning that nearly 1in 5 to 1 in 4 
California superintendents left their districts because they left the profession or the state, or 
they moved to a different district. Given the research showing that it can take several years for 
superintendents to make significant improvements in their districts—a minimum of at least 2 
years—high levels of superintendent turnover can negatively impact student achievement.” 


Table 2. California Superintendent Turnover 


2013-14 2014-15 2015-16 
Movers: Superintendents who moved to a i : . 
different school district zie Bere ome 
Leavers: Superintendents who left the profession 20.8% 31.1% 13.2% 
or state 
Total superintendent turnover 22.9% 23.6% 18.2% 
N 754 734 737 


Source: California Staffing Data File provided to LPI by the California Department of Education through a 
special request. 


Stability among school and district leaders is particularly important in California, where 
continuous improvement is central to the state’s educational strategy. A recent study on 
California’s continuous improvement efforts published by Policy Analysis for California 
Education (PACE) found that staff turnover is undermining the ability of districts to build system 
capacity, which is a fundamental component of continuous improvement. Specifically, high 
leadership turnover “makes it extremely difficult for support providers to build relationships 
and, in turn, to build capacity with district staff. Moreover, if individual capacity is the key to 
organizational transformation, turnover presents a substantial challenge to sustaining 
progress.” Furthermore, as previously discussed, strong school leadership plays an important 
role in mitigating teacher turnover. District leaders interviewed for the PACE study identified 
the inability to attract and retain teachers as a substantial barrier to continuous improvement 
efforts in California.°° 


Educational leaders are important for student success, teacher quality, and leading 
instructional shifts. Leaders are particularly important in California, where school and district 
leaders with fewer resources than those in most states serve students with greater needs. 
Despite the importance of educational leaders and their critical role in supporting students, 
California districts are struggling to find high-quality principals and failing to keep and grow 
quality leaders. 


What Kinds of Preparation and Professional Learning Are Available to California Principals? 


High-quality preparation and professional learning are critical to cultivating and 
developing strong school leaders. In this section, we discuss the attributes of high-quality 
principal preparation and professional development, and we analyze California principals’ 
experiences to determine the quality and comprehensiveness of learning available to school 
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leaders. Although many principals—especially principals who have prepared in the last 5 years— 
—received various elements of strong preparation and professional development, few principals 
received a cohesive set of features associated with high-quality learning experiences. The 
piecemeal nature of California’s learning system leaves principals without some of the most 
valuable elements of quality learning experiences, including a robust internship. California can 
build on areas in which principals feel the most prepared and work on the areas in which they 
report feeling the least prepared. 


The Building Blocks of High-Quality Principal Preparation and Professional Development 


There is a great deal for school leaders to learn in order to manage their range of 
responsibilities, from setting direction to developing people to redesigning their schools to 
leading instruction. Fortunately, in recent years, researchers have learned more about how to 
construct principal preparation and professional development programs that are effective at 
enabling principals to improve both student learning and teacher effectiveness and retention. 
Research points to several key building blocks of such high-quality programs” (see Figure 4). 


Figure 4. Building Blocks of High-Quality Preparation and Professional Development 


High-Quality Principal 
Preparation & Development 


Source: Sutcher, L., Podolsky, A., & Espinoza, D. (2017). Supporting principals’ learning: Key features of effective 
programs. Palo Alto, CA: Learning Policy Institute. 


High-quality programs require strong partnerships between the district and the 
principal preparation and/or development program. These partnerships involve close 
collaboration between the district and program and targeted, joint recruitment of program 
participants. They provide the foundation for effective programs. 


High-quality programs recognize that learning is a social activity and include 
collaborative structures to train and support principals, such as cohorts and networks of 
program participants. Having principals learn together reflects the collegial and collaborative 
school environments that they will work within and foster. It also helps to curb the feelings of 
isolation that principals frequently report. 
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High-quality programs incorporate applied, problem-based learning methods; field- 
based internships; and on-the-job coaching by an expert principal. Research demonstrates that 
people of all ages learn and transfer their knowledge and skills best in contexts that are similar 
to real-world situations, thereby grounding learning in authentic experiences while broadening 
problem-framing skills for future situations. 


High-quality programs focus on supporting principals in learning how to improve 
schoolwide instruction, establish collegial teaching and learning environments, and analyze 
and act on data. Principals need to know how to lead instruction and continuous school 
improvement to meet the increasingly rigorous academic standards and dynamic demands of 
students. Consequently, high-quality programs include content that focuses on preparing 
leaders to implement an instructional vision through collective leadership and by improving 
instruction through the use of data. 


Next, we describe California principals’ preparation and professional development, and 
compare those experiences to these building blocks of high-quality learning. 


California Principals Experience Some Elements of High-Quality Preparation and Professional 
Development but Lack Comprehensive Learning Supports 


The results from our 2017 survey of more than 450 principals provide insight into 
California principals’ preparation and professional development experiences. Significantly, 
more than half of California’s principals report preparation and professional development that 
focuses on the kind of content that research suggests is central to effective leadership. Table 3 
shows the proportion of principals who reported that their preparation and professional 
development has emphasized specific content areas to a moderate or great extent. Because 
examining the experiences of recent preparation-program completers is most relevant for 
understanding current access to high-quality preparation in California, Table 3 shows 
preparation experiences for all principals as well as for principals who completed their 
preparation program in 2013 or later. These same comparisons to investigate recent trends are 
not made for professional learning because the survey asks principals to only consider 
professional learning that occurred in the last 2 years.°” (See Appendix B for a full list of the 
programmatic features we inquired about and the survey results.) 


To summarize, these are some of our key findings: 


e California principals who have completed a preparation program recently (2013 or later) 
are significantly more likely to have received the most high-quality features highlighted 
in the literature.°? Recently prepared principals were more likely to have engaged in 
learning on certain leadership topics and to have experienced high-quality preparation, 
as defined in the research literature, including problem-based learning (78%) and field- 
based projects (85%). This may be due in part to the major changes in licensure and 
accreditation requirements at the CTC. 
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O In the last 6 years, the CTC has overhauled standards for administrator programs, 
requiring them to align with the Common Core State Standards and focusing 
more attention on instructional leadership, support for teacher development, 
social-emotional and academic learning, restorative justice practices, and 
student and family supports; boosted standards for clinical preparation, 
including a 2-year induction program after initial licensure; and developed a new 
administrator performance assessment that examines ability to evaluate 
teaching practice, offer productive feedback and developmental support, and 
use data to plan school improvement. 


Over three quarters of California principals reported that their professional 
development emphasized learning how to lead instruction that supports the 
implementation of the new California state standards, including the Common Core State 
Standards and Next Generation Science Standards.°? Moreover, recent program 
completers are significantly more likely to have experienced preparation related to 
California’s new state standards compared to principals more generally (64% vs. 47%). 


In addition, over two thirds (69%) of California principals reported that their 
professional development has emphasized instructional leadership focused on how to 
develop students’ higher order thinking skills, and just over half (54%) of California 
principals and nearly three quarters (73%) of recent program completers reported that 
their preparation programs emphasized this type of instructional leadership. 


About half of California principals reported that their preparation and professional 
development experiences emphasized learning how to design professional learning 
opportunities for teachers, as well as learning how to help teachers improve through a 
cycle of observation and feedback. This percentage is even higher for principals who 
recently completed their preparation—more than three quarters (78%) of these 
principals experienced learning focused on providing this type of feedback for teachers. 


Around half of California principals reported that they participated in professional 
development in the last 2 years that emphasized working with education stakeholders, 
and nearly three quarters (73%) of principals reported that their preparation 
emphasized this work. Recent completers were even more likely to have experienced 
this type of learning (86%). 


Seventy-five percent of California principals reported participating in professional 
development in the last 2 years that emphasized using student and school data to 
inform continuous school improvement. About 80% of recent completers experienced 
preparation on this topic to a moderate or great extent. 


Less than half of all principals reported that their preparation focused to a moderate or 
great extent on discipline for restorative purposes (48%) or supporting students’ 
physical and mental health (47%). However, recent completers again signal positive 
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shifts in California principals’ preparation experiences, with 70% and 61%, respectively, 
receiving learning on these topics to a moderate or great extent. Slightly fewer 
principals received these elements of learning in their professional development (57% 
and 51%, respectively). Principals serving higher concentrations of students from low- 
income families and students of color reported receiving these professional 
development topics more often. This pattern also holds true for principals serving in 
urban areas.” 


e Fewer than one third (30%) of California principals reported that their preparation 
emphasized learning how to recruit and retain teachers and other staff. This remains a 
weakness for recent completers, who are no more likely to receive learning on the topic. 
Similarly, just over one third (38%) reported their professional development addressed 
this topic. Considering the widespread teacher shortages, this is a key area to improve. 


Table 3. California Principals’ Reports of Preparation and Professional Development 
Experiences 


Preparation: The proportion of California principals whose leadership preparation program emphasized the 
following to a moderate or great extent. 


Preparation (Recent Completers): The proportion of California principals (who completed their program in 2013 or 
later) whose leadership preparation program emphasized the following to a moderate or great extent. 


Professional Development: The proportion of California principals whose professional development in the last 
2 years emphasized the following to a moderate or great extent. 

Preparation : 

P Professional 

Development 


Characteristic Preparation (Recent 
Completers) 


Program Characteristics 


Problem-based learning approaches, such as action 


uate : 69% 78%* — 

research or inquiry projects 

Field- d projects in which lied i f 
ield-based projects in whic you applie ideas rom 76% aso = 

your coursework to your experience in the field 

A student cohort—a defined group of individuals 

who began the program together and stayed 73% 80% — 

together throughout their courses 

Instructional Leadership 


Instructional leadership focused on how to develop 


9 OL *** 9 
students’ higher order thinking skills one ie ane 
Instructional leadership focused on raising é eer 5 
schoolwide achievement on standardized tests abe 156 ane 
Select effective curriculum strategies and materials 49% 58% 59% 
Lead instruction that supports implementation of A7% 6a%re* 16% 


new California state standards 
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Preparation " 
P Professional 


Development 


Characteristic Preparation (Recent 
Completers) 


Leading and Managing School Improvement 
Use student and school data to inform continuous 


: 64% 80%*** 75% 
school improvement 
Leada schoolwide change process to improve 69% Payee 12% 
student achievement 
Engage in self-improvement and your own 1% 79% * 70% 
continuous learning 
Shaping Teaching and Learning Conditions 
Create collegial and collaborative work 71% 33%** 57% 
environments 
Work with the school community, parents, . ores r 
educators, and other stakeholders 73% 86% 51% 
Lead schools that support students from diverse 70% 32%** 62% 
ethnic, racial, linguistic, and cultural backgrounds 
Lead schools that support students’ social and 53% 69% 61% 


emotional development 

Develop systems that meet children’s needs and 

support their development in terms of physical and 47% 61%** 51% 
mental health 

Create a school environment that develops 

personally and socially responsible young people 48% 70%*** 57% 
and uses discipline for restorative purposes 


Redesign a school’s organization and structure to 


ie) ie) 9 
support deeper learning for teachers and students ee jee eae 
Developing People 
Design professional learning opportunities for 57% 65% 50% 
teachers and other staff 
Help teachers improve through a cycle of 6% 7Q%4%** 56% 
observation and feedback 
Recruit and retain teachers and other staff 38% 40% 30% 
Manage school operations efficiently 63% 60% 42% 
sinners to support improvements in school 51% 60% 37% 
Meeting the Needs of All Learners 
Meet the needs of English learners 54% 68%** 67% 
Meet the needs of students with disabilities 53% 75 %*** 56% 
Equitably serve all children 62% 79%*** 68% 


Note: Statistical differences denoted by: *** p<0.01, ** p<0.05, and * p<0.1; Comparisons are made between 
principals who reported completing their preparation since at least 2013 and principals who completed their 
program before 2013. 

Source: Learning Policy Institute. (2017). Survey of California Principals. 
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As outlined in Table 3, many principals have experienced individual elements of high- 
quality preparation and professional development. Principals who completed their preparation 
program in 2013 or later have been exposed to these elements to an even greater extent, 
suggesting positive trends in California’s administrator preparation system. However, as we 
discuss below, few California principals have experienced the full complement of programmatic 
elements associated with developing strong principals. 


Initial preparation. While individual programmatic elements are important, a minority 
of California principals have experienced the combination of several learning structures and 
topics that are associated with positive school outcomes. In Table 4, we identify the 
percentage of California principals who received the comprehensive elements of high-quality 
initial preparation reviewed at the beginning of this section. Specifically, we created three 
different “bundles” of preparation, with Bundle 1 representing piecemeal preparation because 
participants did not experience this collection of elements at least to a minimal extent and also 
were not encouraged to apply to the program and did not participate in an internship longer 
than 20 hours. In contrast, Bundle 3 represents comprehensive preparation because it includes 
elements from each of the four building blocks of high-quality preparation, with participants 
agreeing that the program included the characteristics at least to a moderate extent. 


Only 1 in 20 California principals received comprehensive preparation that incorporated 
several of the elements associated with the development of effective principals. These 
elements of principals’ preparation included 


e being formally or informally encouraged to apply, which often reflects a close 
collaboration between preparation programs and school districts that support 
principals’ learning; 

e learning among a cohort of peers; 

e participating in authentic learning opportunities, such as an internship of longer than 20 
weeks with a mentor; and 

e engaging, at least to a moderate extent, in problem-based learning approaches; field- 
based projects; and learning focused on instructional leadership, creating collaborative 
work environments, and using data for continuous school improvement. 


So while the vast majority of California principals have experienced some features of 
high-quality preparation, as noted in Table 3, few received a comprehensive package including 
all of the core learning opportunities and structures. 


When looking at recent preparation program completers (2013 or later), only slightly 
more principals received the most comprehensive bundle of preparation (and the difference is 
not statistically significant). However, more than twice as many recent completers (37% vs. 
16%) experienced the basic preparation bundle. Again, this is evidence that California’s 
principals who recently completed their preparation program are receiving more elements of 
high-quality preparation in the last 5 or so years—a promising trend. However, the majority of 
recent completers (56%) still received piecemeal preparation. 
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Table 4. Percentage of Surveyed California Principals Receiving High-Quality Preparation 


TUT ate | (= hed 
Piecemeal 


Building Blocks 


Bundle 2-— 
Basic 


Bundle 3- 
Comprehensive 


Preparation 
Partnerships between districts and programs 
Formally or informally encouraged to apply 
Cohorts and networks for collegial learning 


In a cohort Some or none 


Applied learning 


Internship longer than 20 weeks with 
mentor 


Problem-based learning approaches, such as 


5 : : : Some or none 
action research or inquiry projects 


Field-based projects in which you applied 
ideas from your coursework to your 
experience in the field 


Some or none 


Focus on instruction, organizations, and using data for change 


Instructional leadership focused on how to 
develop students’ higher order thinking 
skills 


Emphasized how to create collegial and 
collaborative work environments 


Some or none 


Some or none 


Emphasized how to use student and school 


data to inform continuous school Some or none 


Preparation 


At least toa 
minimal extent 


v 


At least to a 
minimal extent 


At least toa 
minimal extent 


At least toa 
minimal extent 


At least to a 
minimal extent 


At least toa 


Preparation 


v 


At least to a 
moderate extent 


v 


At least to a 
moderate extent 


At least toa 
moderate extent 


At least toa 
moderate extent 


At least to a 
moderate extent 


At least toa 


, minimal extent moderate extent 
improvement 

Percentage of all principals 79% 16% 5% 
Percentage of principals (recent completers 56% 37%0«# 1% 


only) 


Source: Learning Policy Institute. (2017). Survey of California Principals. 

Notes: “Bundle” definitions are mutually exclusive and add up to 100%; Statistical differences denoted by: *** 
p<0.01, ** p<0.05, and * p<0.1; Comparisons are made between principals who reported completing their 
preparation since at least 2013 and principals who completed their program before 2013. 


Part of this difference could be due to the fact that all recent program completers 
completed a leadership preparation program. The same is not true of all principals. California is 
the only state with an “exam-only” route to a credential in which candidates can earn an 
administrative credential without completing an administrator preparation program.” In recent 
years, fewer California principals are entering the profession having earned their preliminary 
administrative services credential via the exam-only route. Prior to 2011, this exam had a high 
pass rate, and about one third of entering principals took the exam-only route; thus, many 
certified principals were not trained, and this was especially true in high-minority schools. 
However, this exam-only route into principalship has been strengthened. In 2011, California 
adopted the California Preliminary Administrative Credential Examination (CPACE), an exam 
aligned specifically to California standards, replacing the prior standardized national 
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examination, the School Leaders Licensure Assessment (SLLA). In 2015, the CPACE was revised 
to incorporate a performance assessment component. Both changes have resulted in lower 
pass rates on the examination.® In 2013, the CTC increased from 3 to 5 the minimum number 
of years of teaching experience necessary to be eligible for the administrative credential.™ 
These policy changes have likely affected the numbers of new principals earning an 
administrative credential through the examination-only route. Our 2016-17 survey estimates 
that roughly 9% of all principals in California entered the principalship without attending a 
preparation program. Therefore, when comparing recent program completers to all principals, 
higher rates of basic preparation can be explained in part by the fact that recent completers at 
the very least finished a program. 


High-quality preparation programs provide participants with the opportunity to engage 
in an internship and field experience—defined as working directly with a mentor principal and 
engaging in administrative tasks under the mentor’s supervision—in which they can practice 
the leadership activities they will engage in as principals. Only 61% of California principals 
reported receiving a supervised internship or field experience before becoming a principal, and 
a much smaller proportion of California principals (24%) reported that they participated in an 
internship of a sufficient duration and frequency (i.e., more than 20 weeks with mentoring from 
an expert at least once a month). Although a similar proportion of recent completers report 
receiving a supervised internship, almost twice as many (47% vs. 24%) experienced a high- 
quality internship experience as described above. Of the California principals who participated 
in an internship, three quarters (74%) said it was an excellent learning experience for becoming 
a principal. Principals serving in schools with a high proportion of students of color particularly 
found these learning opportunities helpful.°° Providing quality internship experiences to 
aspiring principals appears to be an area for continued improvement in the state. 


Professional development. As with preparation, the majority of California principals 
have experienced some of the components of high-quality professional development. However, 
it is the combination of learning structures and topics within professional development that 
produce principals associated with improved school outcomes—and few principals have 
experienced this type of high-quality professional development within the last 2 years. In Table 
5, we created three different bundles of professional development, with Bundle 1 representing 
piecemeal development because participants did not experience certain learning opportunities 
at least to a minimal extent, did not participate in a professional development network, or did 
not have a formal on-the-job mentor or coach. In contrast, Bundle 3 represents the most 
robust, high-quality professional development because it includes the comprehensive set of 
each of the key elements of quality professional learning as described in the building blocks, 
with participants agreeing that they engaged in these learning structures and topics at least to a 
moderate extent. 
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Table 5. Percentage of Surveyed California Principals Receiving Quality Professional 
Development 


Bundle 1-— Bundle 2- Bundle 3- 


Building Blocks Piecemeal Basic Comprehensive 
Preparation Preparation Preparation 


Programs structured to support learning 


In a professional development network v 
Meaningful and authentic learning opportunities 

Formal on-the-job mentor or coach v v 
Mentoring occurred once or twice a month V 
or more 


Learning opportunities focused on what matters 


Instructional leadership focused on how to At least toa At least toa 
5 feck eons : Some or none ane 
develop students’ higher order thinking skills minimal extent moderate extent 
Emphasized how to create collegial and At least toa At least toa 
: : Some or none fos 
collaborative work environments minimal extent moderate extent 
Emphasized how to use student and school 
i ee —e = en At least toa At least toa 
data to inform continuous school Some or none a8 
. minimal extent moderate extent 
improvement 
Percentage of principals 65% 22% 13% 


Source: Learning Policy Institute. (2017). Survey of California Principals. 
Note: “Bundle” definitions are mutually exclusive and add up to 100%. 


Only 13% of principals received what we define as comprehensive professional 
development that includes 


elearning within a principal network; 

e formal on-the-job coaching; and 

e engaging in professional learning that covered, at least to a moderate or great extent, 
instructional leadership, creating collaborate work environments, and using data to 
drive school improvement. 


Principals serving in urban districts were nearly 4 times more likely to receive the most 
comprehensive bundle of professional development than those serving in rural districts (15% 
vs. 4%). Superintendents confirmed the challenges in delivering professional development in 
geographically isolated rural school districts. One superintendent explained: 


And then [there are] rural [schools] up north, for example, that are so spread out. And 
they’re serving a community that’s 30, 40 square miles. And ... [principal] training 
becomes an issue. 


In addition, first-year principals were more likely to experience the comprehensive 
bundle of professional development than seasoned principals who had more than 10 years of 
experience (23% vs. 7%, respectively)°’ and were also more likely to experience the basic 
bundle of professional development compared to both principals with between 5 and 10 years 
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of experience and those with more than 10 years of experience (39% vs. 17%, and 39% vs. 9%, 
respectively).°® While the increased support for novice principals is both promising and 
unsurprising, the proportion receiving quality on-the-job support is still low. About three 
quarters of first-year principals could benefit from expanded professional learning. Moreover, 
given the significant instructional shifts in the last few years in the state, even experienced 
principals need ongoing learning to understand how best to support these changes. However, 
the vast majority of experienced principals are not receiving this type of support. California can 
do a better job of supporting the professional learning of principals from all experience levels, 
with pressing attention needed for the principals in rural areas, who currently have the least 
access to this type of support. 


California Has Room to Grow in Key Areas of Principal Professional Learning 


We turn now to the extent to which California principals perceive their preparation and 
professional development as having adequately prepared them for the challenges of leading 
their schools effectively.°? We describe California principals’ reports of the areas in which they 
feel most and least prepared by their preparation and professional development experiences. 
Although some California principals report that their experiences left them feeling well 
prepared, our results indicate that a significant proportion of California principals have not 
received the support that would help them address the numerous shifts in education policy and 
practice. (See Appendix B for a full list of the content features we inquired about and the survey 
results.) 


Strengths. The three areas in which principals received the strongest preparation—that is, 
principals considered themselves to be well prepared—include: 


1. Engaging in self-improvement (65% felt well or very well prepared) 
2. Creating collegial working environments (60% felt well or very well prepared) 
3. Working with parents and communities (60% felt wel/ or very well prepared) 


Recent program completers, who reveal more about the current trends in the 
preparation of California’s principals, report the same three areas of strength, albeit to a higher 
extent. Of principals who completed their preparation program in 2013 or later, 82% report 
feeling well or very well prepared by the program to engage in self-improvement, 77% report 
the same level of preparedness to work with parents and communities, and 75% report feeling 
well prepared to create collegial working environments. 


These strengths reflect critical elements of effective leadership. Research, as well as our 
interviews with principals and superintendents, stressed the importance of principals learning 
how to reflect on themselves and develop processes for becoming more effective. For example, 
one principal described how his preparation helped him develop these self-improvement skills: 


| can tell you that the type of [leader] | was prior to the [principal preparation] program 
to what | am now is completely different. And | think it’s because it’s a very unique 

program where you learn about yourself at first, what kind of person you are, and what 
kind of leader you are. And then you learn about others and how they work ... so when 
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you work within organizations, then you can deal with those adult behaviors differently. 
... | know where that person’s coming from because that’s who they are, where in the 
past, | was just like, “Either do it my way or get the hell out of the way.” 


Creating collegial environments and working with parents and communities are two key 
responsibilities for principals, especially under California’s LCAP in which principals must engage 
with many educational stakeholders to develop goals that support student achievement. In 
addition, research shows that key factors in teachers’ decisions about whether to remain ina 
school or in the profession include having time to collaborate and build collegial relationships— 
areas in which principals play a central role. 


In terms of professional development, the five areas in which principals report feeling the 
most prepared include (see Table 6): 


Using data to inform continuous improvement 

Creating collegial and collaborative work environments 
Supporting Common Core instruction 

Engaging in self-improvement and their own continuous learning 
Leading a schoolwide change process 


GT Nr 


Over half of principals feel we// or very well prepared in these areas. These five areas of 
strength reflect several state educational priorities. Specifically, shifting to Common Core 
standards has required schools and districts to understand the instructional changes needed for 
students to succeed under the more rigorous standards. In addition, the implementation of the 
LCAP has encouraged districts to use data to inform how to best serve the needs of all students. 
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Table 6: Reported Strengths and Weaknesses of Leadership Professional Development 
Experiences of California Principals 


Felt very 


poorly or Felt Felt well or 


adequately very well 
prepared prepared 


poorly 
prepared 


Areas in which principals felt most prepared: 


Using student and school data to inform 


: . 10% 35% 55% 
continuous school improvement 
Creating collegial and collaborative work 99% 37% 55% 
environments 
Leading instruction that supports 
implementation of new California state 13% 33% 54% 
standards 
Engaging in self-improvement and their own 11% 35% 5A% 
continuous learning 
Leading a schoolwide change process 12% 35% 53% 
Areas in which principals felt least prepared: 
oe and retaining teachers and other 31% 39% 30% 
ROQWINE how a invest resources to support 25% 30% 36% 
improvements in school performance 
Managing school operations efficiently 19% 42% 39% 


Source: Learning Policy Institute. (2017). Survey of California Principals. 


California principals’ reports of preparedness vary by experience, location, and school 
characteristics. More-experienced principals feel their professional development has better 
prepared them to lead instruction that supports implementation of new California state 
standards.’° More-experienced principals also feel more prepared to implement a schoolwide 
change process. ’* In addition, principals in rural schools and schools serving higher 
concentrations of students from low-income families report feeling less well prepared to create 
collegial work environments and engage in self-improvement, respectively.’? With only about 
half of principals reporting feeling prepared to implement the new state standards, and an even 
smaller proportion of new principals prepared to do so, more professional development is 
needed to make progress on Common Core achievement. 
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Weaknesses. A significant majority of California principals also report feeling 
unprepared in several areas. The three areas in which principals received the least professional 
development and in which they report feeling the least prepared include: 


1. Recruiting and retaining teachers 
2. Managing school operations 
3. Investing resources 


From a fifth to nearly a third of principals report that their professional learning poorly 
or very poorly prepared them to lead in these three areas. As mentioned earlier, principals’ 
unpreparedness to recruit and retain teachers is alarming given the importance of teachers for 
student learning, as well as the shortages of teachers across the state. The school and district 
leaders in our focus groups similarly reported that principals are less prepared to manage 
school operations and invest resources. A former California principal described how his feelings 
of unpreparedness in these areas contributed to his decision to leave the profession after just 2 
years: 


| felt well prepared instructionally, with a deep understanding of standards-based 
instruction and shifts at that time. | felt unprepared in human relations, site 
management, and the day-to-day management of a large facility, with 80 employees 
and 500 kids. ... | felt least prepared in facilities management. Not knowing how to go 
about managing a site and facility—really the nuts and bolts. 


Novice principals report feeling less prepared by their professional development 
experiences in these topic areas. About 42% of principals with 10 or more years of experience 
feel their professional development in managing school operations prepared them well or very 
well, compared to only 20% of principals in their first year.’? In addition, principals with more 
than 10 years of experience more frequently report feeling well or very well prepared by their 
professional development in investing resources to improve school performance than principals 
in their first year (39% vs. 23%).”* 


While almost every principal in California has experienced some professional learning, a 
lot more support and learning opportunities are needed to ensure that the vast majority of 
principals experience a high-quality system of learning. One bright spot is the positive trend and 
relative strength in the preparation experiences of recent program completers. Overall, our 
results suggest that the state’s preparation and professional development programs generally 
need to incorporate more of the evidence-based elements of high-quality learning that will help 
California’s principals support the more rigorous state standards and meet the needs of the 
state’s increasingly diverse learners. In addition, more California principals could benefit from 
internships and mentoring that allow aspiring principals to experience the daily demands of 
school leadership with the support of an expert school leader who can provide coaching and 
model leadership strategies. 
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How Well Prepared Are California Principals to Lead for 21st Century Learning? 


California is making educational shifts to prepare the next generation for a dynamic, 
knowledge-driven economy. Successfully making these educational changes, which we refer to 
as “deeper learning” and “whole child learning,” requires substantial expertise on the part of 
principals. Deeper learning involves the application of knowledge to novel, interdisciplinary 
problems and rigorous, self-directed inquiry. In our survey, we created a deeper learning 
construct using the following survey items: 


e developing students’ higher order thinking skills; 
e creating collegial and collaborative work environments; and 
e organizing schools to support deeper learning for teachers and students. 


Whole child learning includes supporting students’ physical needs as well as their social- 
emotional learning. Social-emotional learning emphasizes skills, such as the ability to 
collaborate or make responsible decisions; mindsets, such as thinking constructively about how 
to handle challenges; and effective habits, such as coming to class prepared. ’”° In our survey, we 
created a whole child construct using the following items: 


e supporting students from diverse ethnic, racial, linguistic, and cultural backgrounds; 

e supporting students’ social and emotional development; 

e meeting children’s needs and supporting their physical development and mental 
health; and 

e developing personally and socially responsible young people and using restorative 
practices for discipline. 


Few California Principals Report Being Well Prepared to Lead for Deeper Learning 


Less than half of California principals have experienced preparation and development 
opportunities that address deeper learning. Not surprisingly, the majority of principals (71%) 
did not experience preparation that prepared them well or very well to lead for deeper learning 
(see Figure 5). 


Principals’ learning experiences related to deeper learning competencies varied across 
contexts. Compared to principals serving in schools with low proportions of students of color, 
principals serving in schools with high proportions of students of color were more likely to 
participate in professional development that covered deeper learning (42% vs. 28%) ’° and feel 
their professional development prepared them well or very well to lead for deeper learning 
(36% vs. 22%).7” 


Although relatively few California principals have received support in this area, the state 
could be trending in the right direction with its newer principals. Principals who completed 
their program in 2013 or later were significantly more likely to experience deeper learning 
competencies in their preparation to a moderate or great extent (62% vs. 37%) and more likely 
to feel well or very well prepared to lead for deeper learning by their preparation (53% vs. 29%) 
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than California principals as a whole. Nonetheless, with 75% of principals in our survey 


reporting they want more professional development related to these three deeper learning 
competencies, this is clearly an area for improvement for California’s principals. 


Figure 5. Proportion of California Principals Prepared to Lead for Deeper Learning 
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Source: Learning Policy Institute. (2017). Survey of California Principals. 


20% 


30% 


37% 


38% 


40% 


Few California Principals Report Being Well Prepared to Lead Schools That Support the Whole 


Child 


A small proportion of California principals have learned about whole child practices in 


their preparation and professional development opportunities. Fewer than one third of 


principals feel wel/ or very well prepared to lead schools that address the needs of the whole 
child (see Figure 6). The same figure also shows the proportion of California principals who 


received preparation and professional development to a moderate or great extent on all four of 


the topic areas related to whole child practices, as well as the proportion who feel that the 
learning experiences on these topics prepared them well or very well. It is more common for 
California principals to report receiving training on supporting the whole child in professional 


development than in their preparation. 
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Figure 6. Proportion of California Principals Prepared to Lead Schools That Support the Whole 
Child 
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Source: Learning Policy Institute. (2017). Survey of California Principals. 


Principals’ learning experiences related to whole child competencies also varied. A 
larger proportion of principals serving in schools with high concentrations of students of color 
were exposed to whole child practices in their preparation program than principals serving in 
schools with a smaller proportion of students of color (39% vs. 25%, respectively).’® The same 
pattern holds true for principal professional development, with principals serving in schools 
with high concentrations of students of color being exposed to whole child practices more 
often than their peers in schools with a smaller proportion of such students. ’? Furthermore, 
principals serving in urban schools feel better prepared by their recent professional 
development related to supporting the whole child than principals serving rural schools (34% 
vs. 18%).°° These results suggest that principals in rural schools need additional support in 
accessing quality professional learning opportunities. Principals who completed their 
preparation program in 2013 or later were significantly more likely to experience learning 
related to whole child practices to a moderate or great extent (56% vs. 32%) and more likely to 
feel well or very well prepared by their preparation (60% vs. 29%) than California principals as a 
whole. Moreover, California principals from all types of schools report wanting more 
professional development in addressing the needs of the whole child, with almost 75% of 
principals desiring additional learning in this area. 
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Which Learning Opportunities Do California Principals Want More Of? 


The vast majority of California principals want additional professional development in 
several leadership topics. Using data from our survey, focus groups, and interviews with current 
and former California principals, we summarize the most pressing learning needs. In summary, 
we found that principals’ preferred methods for engaging in professional development are 
often the least available, such as coaching and networking. The major obstacles to obtaining 
professional development are lack of time and money. These firsthand reports from the state’s 
school leaders can guide investments into designing and supporting quality learning 
opportunities that hold the most promise for raising student achievement. 


California Principals Want More Professional Learning 


Nearly all (98%) of the state’s principals would like to receive more professional 
development on at least one topic. Figure 7 shows the top areas in which principals report 
wanting professional development, based on the results from our survey (see Appendix B for a 
full list). 
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Figure 7. Proportion of California Principals Who Report Wanting More Professional 
Development by Topic 
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Source: Learning Policy Institute. (2017). Survey of California Principals. 


The top three topics of professional development that California principals want more of 
are related to their role in shaping the teaching and learning conditions to better support 
deeper learning and whole child practices, including students’ social and emotional 
development. Specifically, principals want more professional learning focused on understanding 
how to create school environments that develop personally and socially responsible young 
people and use discipline for restorative purposes (91%), how to redesign schools to support 
deeper learning (90%), and how to lead schools that support students’ social and emotional 
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development (89%). In addition, principals report wanting to learn how to develop systems that 
address students’ physical and mental health needs (88%). These top results are consistent 
across respondents, based on both school characteristics and principal characteristics. In other 
words, principals across schools serving high and low concentrations of students of color and 
students experiencing poverty, principals serving urban and rural schools, principals new to the 
principalship, and principals who have been in the job for a long time share a relatively equal 
desire for additional professional learning opportunities in these areas. 


Eighty-eight percent of principals want more professional learning about how to lead 
schoolwide processes to improve student achievement, as well as about how to use student 
and school data to inform continuous school improvement. Furthermore, principals in schools 
serving higher proportions of students from low-income families® and students of color® are 
more likely to report wanting professional development about leading a schoolwide change and 
using data for continuous improvement.®* 


In addition, California principals report wanting more professional learning on 
instructional leadership (88%) as well as in developing people. Principals in schools serving 
higher proportions of students of color®* are more likely to report wanting professional 
development in leading instruction focused on students’ higher order thinking skills.®° With 
regard to developing people, 87% of principals report wanting more professional learning about 
designing professional development for teachers and staff. And 84% of principals report 
wanting more opportunities to learn how to help teachers improve through observation and 
feedback. 


Another notable area in which California principals want more support is in their ability 
to meet the needs of all students. Eighty-four percent of principals report that they would like 
more professional development on how to support students with disabilities, as well as about 
how to equitably serve all children. Moreover, principals in schools serving higher proportions 
of students from low-income families®® and students of color®’ are more likely to report 
wanting professional development in serving the needs of students with disabilities. * 


These results suggest that principals in nearly all California schools, especially those in 
the state’s underserved communities, are in need of professional learning resources in several 
areas. While this finding is unsurprising, it underscores the importance of ensuring that we 
provide our school leaders with the necessary preparation and on-the-job training to help them 
lead schools that better address the persistent achievement gaps in the state. 


The Most Helpful Types of Professional Development Are Not Always the Most Available 


California principals generally find their professional development worthwhile. Between 
70% and 80% of principals find most types of professional development they participated in 
very or extremely helpful (see Table 7). Consistent with the literature on effective professional 
development, the three highest rated types of professional development are: 


1. Peer observation and/or coaching 
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2. Participating in a principal network 
3. Mentoring and coaching 


Table 7. Percentage of Principals Participating in Professional Development and Its Helpfulness 
for Those Who Experience Each Type of Professional Development 


Helpfulness 

Not at all Very or 
Type of Professional ] Or or slightly Somewhat extremely 
Development helpful helpful helpful 
Peer observation/coaching 
in which you have an 
opportunity to visit with 29% 28% 43% 3% 17% 80% 
other principals for sharing 
practice 
Participating in a principal 14% 23% 6% Av% 17% 79% 
network 
Mentoring or coaching by 
an experienced principal as 43% 20% 37% 59% 17% 73% 


part of a formal 
arrangement 


Workshop provided by a 
professional association, 24% 44% 32% 3% 20% 77% 
such as ACSA 


Individual or collaborative 


research on a topic of 21% 39% 40% 3% 21% 77% 
interest 
aera ic 18% 80% 3% 23% 75% 
University course(s) related 

aa 68% 13% 20% 6% 21% 73% 
to your role as principal 
Reading professional books 2% 18% 80% A% A% 72% 
or articles 
Workshops, conferences, or 
training in which a principal 43% 34% 22% 5% 31% 63% 


presented 


Note: Due to rounding, percentages do not always add up to 100%. 
Source: Learning Policy Institute. (2017). Survey of California Principals. 


Even though principals report that these learning opportunities are most helpful, not all 
principals receive this type of professional development. In fact, the learning opportunities that 
principals most frequently report as being very or extremely helpful are some of the least 
available. For example, 43% of principals report not receiving formal mentoring or coaching, 
and nearly 1 in 3 principals report not participating in peer observation. In addition, only 37% of 
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California principals have had a formal on-the-job mentor or coach in the past 2 years (other 
than the mentor or coach in their leadership preparation program). However, nearly all first- 
year principals (95%) who received mentoring or coaching by an experienced principal report it 
was very or extremely helpful. Even 58% of principals with more than 10 years of experience 
found mentoring or coaching very or extremely helpful. 


Three quarters of first- and second-year California principals (77%) received mentoring 
and coaching. The quality of these arrangements varied, and only 43% of first- and second-year 
principals reported having a formal on-the-job mentor or coach with whom they met at least 
once a month. 


One reason for the infrequency of certain types of professional development may be 
that principals in geographically remote districts may not have access to nearby principals 
whom they can observe and with whom they can collaborate within a network. Not 
surprisingly, principals in urban districts are much more likely to participate in principal 
networks than principals currently serving in rural districts (74% vs. 50%, respectively).®? In 
addition, principals currently serving in urban schools are more likely to receive coaching than 
principals serving in rural schools (41% vs. 26%, respectively).”° Principals in urban areas are 
twice as likely to have the opportunity to visit with other principals for sharing practice as their 
peers working in rural schools (49% vs. 24%).°* However, principals in rural areas were more 
likely to rely on professional development offered by professional associations: Only 17% of 
principals in rural districts report not participating in workshops provided by professional 
associations, such as the Association of California School Administrators (ACSA), compared to 
30% of those in urban districts.” 


Considering that principals have limited time and resources to engage in professional 
learning, it is crucial to increase the availability of the most helpful types of professional 
development and invest in a set of strategic high-quality supports. 
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Preparation and Professional Development for Principals in Rural Areas 


Many of the strategies used to support principals in urban and suburban areas are not 
feasible for principals in rural areas because of the profound ways in which rural schools and 
districts differ. For example, because rural schools and districts are geographically remote, 
establishing principal networks requires rethinking the time and space—and in some cases, 
technology—needed to facilitate this learning. 


In California, almost one third of school districts are located in rural areas.?? As noted 
throughout the report, we found significant differences in the learning experiences of 
principals in rural California compared to their peers across the state. Specifically, principals 
in rural areas consistently report participating in preparation development less frequently 
than principals in non-rural schools. We found that: 


e Principals in rural districts are less likely to participate in principal networks and to 
receive coaching than urban principals. Relatedly, principals in rural areas are half as 
likely to have the opportunity to visit with other principals to share their leadership 
practices than their peers working in urban districts. 

Principals in rural districts are 4 times less likely to receive the most comprehensive 
bundle of professional development, compared to principals in urban districts. 


Moreover, principals in rural areas consistently report feeling less prepared than principals in 
non-rural schools. We found that: 


e Principals in rural districts feel less prepared by their recent professional development 
related to supporting the whole child than principals serving in urban schools (18% vs. 
34%). 

Principals in rural schools also report feeling less well prepared to create collegial 
work environments than their urban counterparts (40% vs. 55%). 


Our findings suggest that the state should target resources to identify how to best support 
the learning of principals in rural areas, including ways to break down isolation or perhaps 
create virtual ways to participate in a learning community. 
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Lack of Time and Money Are Obstacles to Professional Learning 


The challenges principals report related to their inability to access professional 
development in areas in which they would like to grow are predictable: time and money. Figure 
8 shows the obstacles California principals most frequently cite that prevent them from 
participating in desired professional development activities. One reason why principals identify 
time as an obstacle is because they feel they are penalized for the time when they are not 
present in their schools. One California principal explained: 


If we’re off-site, we’re not supposed to be off-site. We’re supposed to be on-site. Anda 
lot of the [professional development] is off-site. ... It’s not valued ... that we are learning. 
We are professionals, and we don’t have to be on-site to be able to impact what’s going 
on at our school sites. ... We have to justify [going to professional development] not only 
to our supervisors, but also to our staff and our parents. 


Figure 8: California Principals’ Reported Obstacles to Participating in Desired Professional 
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Source: Learning Policy Institute. (2017). Survey of California Principals. 


Cost is also frequently reported by principals as an obstacle to participating in beneficial 
professional development. Almost half of California principals pay at least part of their 
professional learning costs. In fact, one third of California principals report paying for all of the 
costs associated with their professional learning, and 15% of principals paid part of their costs. 
About half (53%) of principals paid no cost for their professional development. 
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What Are California Superintendents’ Experiences With Professional Learning? 


High-quality professional learning opportunities are critical to cultivating and developing 
strong district leaders. Our review of the available research and our focus groups provide 
insight into the relatively unexplored area of superintendents’ professional learning 
experiences. In this section, we summarize our findings about California superintendents’ 
professional development experiences, including the types of professional learning they find 
most helpful and the obstacles they face to accessing quality learning opportunities. 


Superintendents Receive Piecemeal Professional Development 


In terms of on-the-job learning, our interviews with California superintendents and 
review of national studies provide insight into the most valuable professional learning 
experiences. The vast majority (83%) of superintendents across the nation have reported that 
their professional learning experiences have been useful or very useful.“ Despite the value of 
professional learning, all the California superintendents in our focus groups report that it is 
largely up to them to seek professional development experiences. As one superintendent put it: 


The most highly successful people in this job are people who are not waiting for help to 
come to them. ... They are reading, thinking, calling, pushing, asking, going, and are just 
a machine. And they are so internally driven that then they become the leaders of the 
pack of other people. 


Another California superintendent elaborated: 


| feel well prepared, but the preparation is of my own doing. ... You have to seek out the 
learning. ... What is unique is that at a district level, the superintendent and team 
provide the learning for principals and provide learning for directors and provide 
learning for teachers and classified staff and so forth. But there isn’t anybody above the 
superintendent in terms of providing that learning for us. ... There are opportunities for 
us to seek that learning and lots of professional reading and networks among each 
other. But if you do not seek it out yourself, it does not come to you. 


Another California superintendent described how the autonomy superintendents have 
allows them to identify the learning that best suits their district context: 


[It’s] up to the superintendent to take an active role in seeking professional 
development opportunities. Then | think that we just take a really active role in seeking 
the kinds of professional development that we need and want depending on what the 
focus is for the district. In creating opportunities for my staff, | participate with them. It’s 
more of a learning journey together than having some external agency that we go to or 
bring to us. 
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Superintendents’ Reports of the Most Valuable Types of Learning Opportunities 


California superintendents in our focus groups most frequently reported the following 
four types of professional development as most important to their continued growth. 


Formal and informal networks with peer superintendents 
Coaching and mentoring from seasoned superintendents 
Partnerships and coursework from institutions of higher education 
Professional literature and research 


Powe 


Networks. California superintendents described the important role of formal and 
informal networks of superintendents in their learning. This is consistent with studies across the 
United States in which superintendents have reported that “the most important source for 
informing elements of their practice is peer superintendents.”* Every California superintendent 
in our focus groups emphasized the importance of collaborating with fellow superintendents in 
formal and informal networks. One California superintendent described how interactions with 
other superintendents help her grow: 


| think the more we interact with one another, [the more] you learn ... because you’re 
making meaning of it in your own brain as you’re interacting with somebody. Then 
they’re adding new perspectives to it. Anytime we’ve had opportunities to collaborate, 
that’s been the most valuable. 


Many superintendents echoed this sentiment and emphasized how peer 
superintendents help them strategize and problem-solve. One superintendent described how 
this can occur in more formal settings: 


Usually there’s about four or five of us and a facilitator. We meet four times a year. And 
we have reading materials, and we bring a problem of practice. Then we do sort of a 
fishbowl activity or critical friends or whatever we’re doing and go through that problem 
of practice. ... [We] go around the room and say, “What’s something you’re struggling 
with?” | can’t tell you how valuable that’s been. 


Several California superintendents described the importance of engaging in formal 
networks of superintendents at professional association meetings, such as the National 
Superintendents Roundtable and the ACSA meetings. Some superintendents also said that their 
county offices were effective at convening formal networks of superintendents. 
Superintendents in one county described how they value their monthly meetings with other 
superintendents in the county, which the superintendents get to plan themselves. As one 
superintendent shared: 


We purposefully schedule time for us to interact around different topics. ...We invite 
other superintendents to take a chunk [of the planning], and we really co-constructed 
this meeting. We want them to be really powerful and meaningful. We really drive the 
agenda and ... we have a... team that’s leading the content development for those 
meetings. 
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In addition, some superintendents said that informal networks best support their 
development. All superintendents agreed that developing trusting relationships within their 
networks is critical in order for the networks to be most productive. As multiple 
superintendents explained, without trust, they can be “burned” by peers who do not hold 
conversations in confidence. One superintendent explained that informal networks help to 
support more candid conversations between superintendents: 


We had one superintendent who was going through some baloney through no fault of 
his own ... So we Started asking him, “How are you doing with that?” And then he really 
started sharing honestly, and then someone else said, “Oh, yeah, | went through that, 
too.” 


Networks of superintendents can also materialize through online channels. 
Superintendents in our focus groups referred to their online networks as personal learning 
networks (PLNs). One superintendent said: 


My personal learning network has changed my life. It’s all about my PLN, social media, 
Twitter, and it’s mostly Twitter. That’s where | see that the educators that | want to grab 
ideas from are there. ... | can feel connected and find solutions in 140 characters or less 
and maybe an embedded attachment, but that absolutely is working for me. 


Some superintendents explained how professional associations support their 
development of a professional network. For example, one superintendent described how 
informal networking at a conference helped her better understand how she could support her 
own professional growth: 


The value at a lot of the conferences is the informal networking. ... The session rooms 
are relatively empty. And the lobby and the bars ... [and] restaurants are relatively full 
because it’s just informal networking. We had the best conversation around a high-top 
bar table last year, just about contracts. And all just sharing little things that we have in 
our contracts. ... And so taking little ideas that different people have in their contracts to 
allow them [opportunities for] professional growth. ... Because it’s just not something 
that’s often discussed. 


The superintendents in our focus groups said that they find the resources to participate 
in networks through a variety of channels. One superintendent said: 


One of the requests when | negotiated my contract was the ability to engage in these 
professional networks and for the district to pay for it. 


Other superintendents said that they worked with professional networks to have those 
networks pay for their participation. For example, one superintendent said that the National 
Superintendents Roundtable covered the approximately $2,500 fee to participate because the 
network wanted the superintendent to partner in the work. A survey of more than 1,000 
superintendents across the United States revealed that approximately 94% of superintendents’ 
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contracts cover their membership dues to regional professional organizations, and 73% cover 
their membership to national professional organizations.”° In addition, 86% of superintendents’ 
employment contracts require that the costs of their attendance at professional conferences be 
paid for by the district.?” Accordingly, covering the costs of superintendents to participate in 
networks is an important first step to supporting this helpful form of professional learning. 


Mentoring and coaching. All the California superintendents in our focus group who had 
a mentor or coach underscored their value. A seasoned California superintendent described the 
usefulness of her coach: 


This is my eighth year. | mean, every year, okay, | feel good, but still there’s so much 
more to learn. Having a coach, and for me... it was just somebody that | knew and who 
encouraged me. | think it’s really critical. A lot of times we in education have been shy 
about asking for a coach, where you look at everybody in any executive position, the 
CEO of GM and Ford and Coca-Cola, and they all have coaches. 


Another superintendent echoed that sentiment: 


For me personally, having an executive coach, somebody who | can have absolute trust 
in, who’s going to tell me the truth even when | don’t want to hear it, has been very 
powerful. 


Superintendents report finding coaches and mentors through informal and formal 
channels. One superintendent explained that she “begged” an acquaintance to be her coach. 
Sometimes a coach is someone a superintendent already knows or someone the district already 
has a relationship with. Others explained that there are firms that provide superintendents with 
a list of potential coaches. 


Despite the value of coaches and mentors, in a national survey of superintendents, less 
than 8% reported that their employment contract provided financial support for a coach or 
mentor.°? Some California superintendents in our focus groups described how their school 
board has provided financial support for coaching. For example, one superintendent shared: 


| have a coach. ... | have a person on retainer that | can call. And so the board knows that 
there are times that I’m going to need to reach out to somebody and is very supportive 
in that piece. And so | just have an open contract with someone who actually was a 
mentor to me. And so not knowing, there are times that it might just be a quick call. But 
there are other times you might get yourself in a really deep issue. We’ve had a couple 
of those over the years. ... and so | do have a contract with someone that | can call 
anytime for that coaching piece. 


Some county offices paid for or provided coaching to superintendents. However, some 
in our focus groups described situations in which superintendents in districts with limited 
funding often paid for coaches out of their own pockets. Other superintendents in similar 
circumstances try to find informal mentoring and coaching relationships but found that not 
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paying for this guidance sometimes limits their use of this valuable relationship. As one 
superintendent explained: 


When you are paying for somebody’s time, you don’t feel guilty at all about picking up 
the phone and saying, “I need you.” ... When you know this person’s doing it out of the 
goodness of their heart, then maybe you hesitate. 


One superintendent suggested that the benefits from her coach far outweighed the 
costs: 


The whole [coaching] contract is a couple thousand dollars. ... The mistake | might make 
would be far more costly than the contract is. 


Partnerships. Several superintendents described how partnerships with and coursework 
at institutions of higher education have supported their professional development. 
Superintendents located near esteemed public and private research universities described 
collaborations that support the professional learning of the district and school leaders and its 
teachers. One superintendent described a 2-year program at UC Davis, the Superintendent 
Executive Leadership Forum: 


That was really, really helpful. ... That was amazing. For 2 years, we would go for like a 
whole day and a half. ... We had all these different people come in and actually spend 
quite a bit of time. Then we were a cohort, so we stayed together as superintendents 
for 2 years. This program required that someone had to recommend you to participate 
in the program. And then the program participants recommend others. 


A superintendent in the Bay Area described an informal group supported at Stanford 
University: 


One of our superintendents has a connection with Stanford’s Graduate School of 
Education. And we created this little, like, book study. And it’s just the superintendents 
in our county, and we do research on somebody who works at Stanford ... who is doing 
some interesting work. And then you read all of their materials and you prep for it. Then 
we spend a day with that individual at Stanford. We all pitch in like $35 bucks or 
something. We get lunch at the faculty club, but you spend the whole day really delving 
in deeply to a topic like diversity intolerance that is so important right now. 


Superintendents in the most well-resourced districts described the value in attending 
leadership development courses during the summer at more remote universities, such as 
Harvard and Columbia Teachers College. 


Superintendents also described how nearby institutions of higher education facilitated 
their district’s relationships with community leaders. For example, a superintendent in 
Southern California explained the value of partnerships with private sector leaders: 
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| think what really helps is going beyond the whole educational sphere. And we’ve had 
great relationships [with institutions of higher education, in] which they tried to pair 
business and education. Many of us have had just amazing positive encounters with a 
company like Qualcomm. Or many of us have taken our leadership teams to their 
facilities and learned how they look at strengths from their leaders’ perspectives. 


The superintendent went on to elaborate on how interactions with private sector 
leaders provide insight into how to better address education challenges: 


We’ve been able to actually utilize some of their techniques with our leaders, and [that] 
has helped me tremendously because | think we can be very isolated in education. And 
you know, if we’re meant to prepare our students for the business world, and we’re not 
connected to the business world, you know there’s a disconnect there. 


Readings. Nearly all California superintendents we interviewed said that they regularly 
engaged in reading research and other professional literature. One California superintendent 
said: 


The superintendents that | know are always looking for good stuff to read. ... Then they 
tell each other. | feel guilty if a week has gone by and | haven’t been reading a really 
good article about something or looked at some research. 


Superintendents across the United States similarly express being frequent readers of 
professional literature.”’ A survey of almost 2,000 superintendents across the United States 
found that the following topics were of the greatest value to them: law and legal issues, 
finance, personnel management, school reform and improvement, superintendent—board 
relations, and school-communhity relations. °° 


Few Superintendents Report Being Well Supported to Lead for 21st-Century Learning 


Despite superintendents’ important role in creating the conditions that help address the 
needs of the whole child and in fostering students’ social and emotional development, as well 
as providing opportunities for students to engage in deep learning, California superintendents 
in our focus groups reported that they have received little to no support in these areas. 
However, all the superintendents stressed the importance of supporting students in these 
ways. For example, one superintendent said: 


| also think [fostering social-emotional learning] is the most difficult thing we do. How 
do you teach a student that needs fast gratification to persevere for 13 years in the 
public school? You have to teach self-efficacy, and | think it comes through things like 
sports and some of our programs that really are probably a lot more important than 
even the academics. 


A few superintendents said that they seek out nearby resources to educate themselves 
and their staff about these educational shifts. To learn how to support students socially and 
emotionally, one Bay Area superintendent said, “You kind of fill in your holes with SEL.” This 
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superintendent sought out locally available experts and resources from nearby institutions of 
higher education. 


However, because many superintendents rely on their local resources, superintendents 
in areas with less access to education scholars, experts, and other organizations reported that 
this contributes to significant regional variation in educators’ understanding of how to support 
students in developing deeper learning and in social, emotional, and whole child competencies. 
A superintendent located in a rural school district described the variation in educators’ 
understanding of deeper learning and social and emotional learning: 


So we went to [a professional learning program for teachers and leaders]. It was all deep 
learning and social-emotional learning. And the fascinating thing around our table was 
[there were] people at the table who had never heard the term. And I’m new to the 
district, kind of, at that point that we went to the training. And so ... well, all right, so 
they haven’t been staff developed in this, the teachers really don’t understand, and | 
have an administrator who says, “In our district, we’ve never used those exact words.” 
So that just shows you the differences in levels in communities, and we’re a little bit 
more isolated. 


A superintendent who moved from a Bay Area district to a school district located in the 
desert said: 


| came from a place where we did have mindfulness throughout our district, and we had 
it in PE in middle schools, where every PE class was doing mindful practices every day. | 
mean, so you have those level of districts ... where they have real mindfulness 
curriculum and real social and emotional curriculum, to a community in the desert that, 
we’re not even using those terms. 


District leaders across California understand the importance of preparing students 
academically, socially, and emotionally; however, they reported often lacking the resources to 
educate themselves and their staff about teaching and learning in this way. These findings 
suggest that better equipping superintendents with resources and training in these areas might 
allow both principals and superintendents to better support California students’ achievement. 


Superintendents’ Obstacles to Professional Development 


Like principals, superintendents most frequently reported that the biggest obstacle to 
pursuing professional development is lack of time. Superintendents reported that their district’s 
expectations and culture generally discourage them from taking the time to leave their district 
to invest in their own growth and effectiveness. One superintendent sarcastically explained: 


My board, they don’t want me out, because if I’m out, I’m not attending to the dog 
that’s running loose. I’m not making sure the two-ply toilet paper arrived, that sort of 
thing. 
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Superintendents also described the haphazard nature of the most beneficial 
professional development opportunities. Some superintendents said that their county offices 
do not convene superintendents in the district. Consequently, superintendents with inactive 
county offices shared that they need to participate in other professional organizations and 
meetings to actively identify valuable professional learning opportunities. Several 
superintendents said there are few formalized structures to establish mentors and coaches. 


Superintendents also said that the increasing number of services offered in their 
districts means that they need more types of professional learning. For example, one California 
superintendent said she has a medical clinic, dental clinic, and food pantry in her district; 
however, she does not know anything about running a comprehensive health clinic. And she 
does not know where to go to learn about leading these services. 


In the next section we review California’s past and current policies that support school 
and district leaders’ preparation and professional learning. Understanding the current and 
historical context in the state will be key for identifying next steps to strengthen the system of 
learning for California’s educational leaders. 


Review of Past and Current Policies Supporting California Leaders’ Preparation and 
Professional Learning 


In the past, California made significant investments in professional learning for the 
state’s education leaders; however, these investments have been largely eroded over time, and 
for many years there was no state investment in leaders’ professional learning. Recently, the 
state has taken significant action to improve the quality of principal preparation. Some modest 
investment in principals’ professional learning has also occurred, but it represents a fraction of 
what it once was. In this section, we review prior and current state policies influencing 
California school and district leaders’ preparation and professional learning. 


Policies Related to Preparation 


California’s system of school leader preparation is a two-tiered pathway. Individuals 
earn their preliminary administrative services credential through one of three pathways: 
traditional, intern, or exam—or they enter California from out of state. Novice administrators 
must then complete a 2-year induction program in order to earn the clear administrative 
services credential, which provides intensive coaching and job-embedded professional 
development. Over the past several years, the CTC has made significant changes to the 
standards, assessment, and accreditation policies that govern the preparation and credentialing 
of California’s school administrators. 


Beginning in 2013, the CTC updated and substantially revised the standards that guide 
the preparation, induction, and professional learning of California’s education leaders. These 
include the California Administrator Performance Expectations (CAPE), which apply to 
candidates for the preliminary administrative services credential, and the California 
Professional Standards for Education Leaders (CPSEL), which apply to practicing administrators, 
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including those earning their clear administrative services credential. The standards define 
what California has said school leaders should know and be able to do. The revised standards 
are more aligned to the evolving role of school leaders, including a focus on whole child/whole 
school. For example, the CPSEL include six standards for California’s school leaders: 


Development and Implementation of a Shared Vision 
Instructional Leadership 

Management and Learning Environment 

Family and Community Engagement 

Ethics and Integrity 

External Context and Policy 


Ag RwWN PE 


Beginning in fall 2018, California will fully implement a new administrator performance 
assessment, the CalAPA.*™ All preliminary administrative services credential candidates 
completing a preparation program will be required to pass the CalAPA to earn their preliminary 
administrative services credential. Only two other states—Connecticut and Massachusetts— 
have anything similar. This assessment requires administrative credential candidates to 
demonstrate their leadership knowledge and skills through an authentic task-based structure 
completed at three different times during the candidate’s school site placement during their 
administrator preparation program. Candidates must complete and pass three separate 
leadership cycles: 


e Cycle 1: Developing a Culture of Professional Learning for Improved Student Learning— 
in which candidates must facilitate collaborative learning among a small team of 
teachers 

e Cycle 2: Using Data Collaboratively to Inform School Improvement—in which candidates 
must collect and analyze multiple sources of data, engage staff and other stakeholders 
in a strengths and needs analysis, and develop a plan for student learning informed by 
the data 

e Cycle 3: Supporting Individual Teachers Through Observation and Coaching—in which 
candidates must coach at least one teacher through at least two observations, with pre- 
and post-conferences 


The CalAPA was piloted in the 2016-17 school year (with more than 40 programs 
participating) and field-tested in 2017-18 (with approximately 25 programs). It will be 
administered across all California programs in 2018-19 during a phase-in year of 
nonconsequential administration, and it is set to be fully implemented in 2019-20. The CalAPA 
will be centrally scored, and results will be reported on the CTC’s data dashboards and used as 
an outcome measure for preparation program accreditation processes.” 


The CTC has also revised its program accreditation system to streamline and strengthen 
the state’s processes for holding both teacher and administrator preparation programs 
accountable for meeting the state’s standards.’ This includes increasing the use of reliable 
candidate and program outcomes data from a variety of sources, including performance 
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assessment scores and surveys of candidates, employers, and a variety of other stakeholders. 
The new system also increases the amount and scope of publicly available information about 
the quality and outcomes of preparation programs in order to provide increased transparency, 
including through the use of data dashboards. 


The newest cohort of individuals who completed a California administrator preparation 
program report high levels of preparedness across many indicators. In fact, more than 95% of 
program completers who were recommended for a credential between September 1, 2016, and 
August 31, 2017, reported their preparation program was effective or very effective in helping 
them develop the skills and tools needed to become a school leader.*™ Although unlike the 
respondents in our survey, these program completers have not yet entered principal 
positions, but the overwhelmingly strong responses indicate that some of the state’s advances 
in its preparation policies may be taking hold. 


Policies Related to Professional Learning 


In the past, California has made significant investments in statewide programs to 
support the professional learning of school leaders. For nearly 20 years, the state sponsored 
and funded the California School Leadership Academy (CSLA), which was launched in 1983 
under Senator Gary Hart’s SB 813. CSLA’s mission was to “develop leadership focused on 
teaching and learning so that each student meets or exceeds standards.” Twelve county offices 
of education received grants to host the CSLA School Leadership Centers regionally, and these 
centers served the entire state. In 1992, CSLA, in collaboration with the ACSA, began to offer 
professional development for superintendents through an Executive Leadership Center. More 
than 25,000 school leaders, including at least 600 school superintendents, participated in these 
programs, which offered intensive, long-term training (for example, 10 to 15 multiday sessions 
annually for 1 to 3 years) for both individual leaders and leadership teams. *° 


The CSLA was recognized nationally as a source of high-quality professional 
development. For example, a study of the practices of 44 graduates of its 3-year training 
academy identified it as a highly effective model of instructional leadership development. 
Other accounts of the training and its outcomes reinforce these findings. “°’ One researcher 
with extensive experience in studying educational leadership development programs observed: 


106 


Overall, CSLA offers some of the most carefully designed, conceptually integrated, 
locally sequenced, and reform-focused programs in the country. Its set of 

training modules, regional structure, attention to developing leaders for a standards- 
based setting, and efforts to produce a coherent and powerful collegial culture make it a 
well-developed professional development package. The program’s ability to build a 
strong network and cohesive professional culture across the state is unique among 
programs. *°8 


Aspects of CSLA’s work were adopted in Alabama, Arizona, Louisiana, Mississippi, New 
Mexico, New York, and Texas; the Department of Defense Schools; and Australia, Kuwait, the 
Netherlands, and Sweden. Before it was discontinued in 2003 as a result of statewide budget 
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cuts, the California Legislature appropriated $1.5 million annually for the ongoing program 
development and administration of the overall program and $4.1 million for grants to the 
regional centers. Some of the CSLA work continues as a “leadership initiative” project within 
WestEd, supported on a fee-for-service basis. However, the full mission of the Academy has 
been difficult to sustain without state funding. 


In 2001, the state authorized a Principal Training Program under Assembly Bill 75 
(Chapter 697, AB 75, 2001), later reauthorized as Assembly Bill 430 (AB 430, 2006) and 
renamed the Administrator Training Program. Now defunct, the program provided incentive 
funding for local educational agencies (LEAs) to train school-site administrators—mostly 
principals and vice principals—primarily to administer the state-approved curriculum. The total 
appropriation for the program was $27.5 million when it was authorized, or about $5 million 
per year. In 2005—06, $1.5 million in federal funds augmented the program. Until February 
2006, the Bill and Melinda Gates Foundation supported some of the costs of program 
implementation through an $18 million grant. 


For each participating administrator, the state allocated $3,000 to the LEA to underwrite 
the cost of training. For each $3,000 received, LEAs were required to provide $1,000 in 
matching funds for training-related costs. Training was offered by providers approved by the 
State Board of Education. Each principal had to complete a minimum of 160 hours of training 
(an 80-hour institute and 80 hours of individualized support), and LEAs could negotiate with the 
training providers to offer up to 10 more hours of training to their administrators. In 2009, the 
program became subject to categorical flexibility and is now no longer funded. Until 2013, 
completion of the Administrator Training Program satisfied the program requirement for the 
clear administrative services credential.*° 


In 2013, the state superintendent of public instruction endorsed the Quality Professional 
Learning Standards (QPLS), which establish a set of research-based standards about 
professional learning for educators—both teachers and administrators. The QPLS “identify 
essential elements of quality professional learning that cut across specific content knowledge, 
pedagogical skills, and dispositions.” *”° Specifically, the QPLS focus on the following: data, 
content and pedagogy, equity, design and structure, collaboration and shared accountability, 
resources, and alignment and coherence. The goal of the standards is to create a shared 
understanding of the elements of high-quality professional learning so that education 
stakeholders can be better united to support it. 


In 2015, the California Legislature provided $490 million in one-time funds to LEAs that 
could be used in a variety of ways to enhance educators’ effectiveness, one of which was 
administrator induction and/or professional learning. LEAs had until July 1, 2018, to report on 
how they spent these funds. Consequently, at the time of this report’s publication, it is unclear 
how much of the educator effectiveness funding has been used to support administrators 
versus how much has been used to support teachers. 
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In 2017, the Legislature created a new competitive grant program to support teacher 
and leader recruitment and retention: the California Educator Development Program (CalEd). 
Funded at approximately $9.2 million—with $6.5 million of that targeted to support 
professional learning for principals and other school leaders—the program repurposed federal 
Title Il funds pursuant to the Elementary and Secondary Education Act of 1965. In 2018, 26 LEAs 
received grants ranging from approximately $100,000 to $1 million, with grant recipients 
required to provide matching resources. The program is administered by the California Center 
on Teaching Careers, under Tulare County Office of Education. 


While the state has made significant improvements in principals’ preparation, it has not 
made similar advances in principals’ and superintendents’ access to high-quality professional 
learning. Although California’s recent investment in professional learning for school and district 
leaders is a step in the right direction, there remains significant need statewide for increased 
attention to and state investment in the ongoing learning of its educational leaders. In the next 
section we discuss policy considerations. 


Policy Considerations 


Because of the importance of California’s principals and superintendents to student 
achievement and teacher quality, policymakers have good reason to invest in the preparation, 
training, and professional learning of education leaders. Although high-quality preparation and 
development for school and district leaders requires financial investments, the benefits can be 
substantial when considering principals’ and superintendents’ influence on school culture, 
teacher quality’** and retention, ’* and, consequently, student outcomes. Moreover, there is 
an emerging body of research suggesting that participants in high-quality programs are 
associated with leading schools with increased gains in student achievement as well as teacher 
satisfaction and quality.‘?? For example, one effective professional learning program estimated 
that the $4,000-per-candidate cost of the program equated to approximately $117 per 
additional student achieving proficiency.*“* In contrast, other policies that have had a similar 
influence on student learning are more expensive, such as whole school reform and class-size 
reduction.*”° For example, the median cost of comprehensive school reform efforts is 
approximately $85,000 per school.*?® 


Our research suggests several ways in which state and local policies can support the 
preparation and development of education leaders so that they are better equipped to support 
strong student outcomes as well as teacher quality and retention. 


Professional Learning 


1. Ensure that California’s emerging statewide system of support targets the 
professional learning of school and district leaders. California is in the midst of a fundamental 
overhaul of its school accountability and continuous improvement system, with the 
architecture of a system of support for districts and schools just beginning to emerge. During 
the 2017-18 school year, LEAs were, for the first time, identified for differentiated assistance 
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and support under the Local Control Funding Formula (LCFF) based on their performance across 
multiple state and local indicators on California’s School Dashboard. Responsibilities for 
supporting districts in need of assistance are shared among California’s 58 county offices of 
education, the California Collaborative for Educational Excellence (CCEE), and the California 
Department of Education. 


Given the important role of school and district leaders in leading change processes, 
recruiting and retaining teachers, and improving student outcomes, California’s emerging 
statewide system of support could focus on developing and supporting effective educational 
leaders. California needs to rebuild a statewide infrastructure for professional learning for 
school leaders—a notable gap in its current policy context. The 2018-19 state budget 
proposes to make significant new investments in the statewide system of support, including by 
investing in eight “lead” county offices of education, which will provide training, resources, 
and support for other county offices of education.*’’” The state could ensure that these lead 
county offices of education provide coordinated, intensive, and sustained professional learning 
and support to California’s school leaders. This is a role that county offices of education have 
successfully played in the past, when 12 county offices of education served as regional hubs 
for the CSLA. Moreover, the state should ensure that the county offices address the unique 
learning challenges of administrators in rural areas. 


Importantly, the Every Student Succeeds Act (ESSA) provides federal funds that can be 
leveraged to support the development of school leaders. California’s ESSA plan indicates the 
state’s intention to take advantage of the optional 3% set aside under Title II, Part A of ESSA to 
invest in school leadership development—estimated to be approximately $6.5 million. Twenty- 
four states, including Georgia, Michigan, New York, Texas, and Wyoming, are using the 3% set- 
aside to invest in systems of support for school leaders, including school leadership academies. *”® 


Additionally, ESSA requires that states set aside 7% of their Title |, Part A, funds to 
improve low-performing schools by using evidence-based strategies that improve student 
learning. Some of these funds, estimated to be approximately $120 million for California, could 
be used to implement research-based interventions to strengthen school leadership in low- 
performing schools and districts.‘*? These funds could also be used to experiment with 
approaches to addressing the unique learning challenges of administrators in rural areas. A 
recent study by the RAND Corporation identified multiple school leader interventions that meet 
ESSA’s evidence-based requirements. ”° One example is the National Institute for School 
Leadership, which currently serves approximately 250 California school leaders from 27 school 
districts. 


As part of this statewide system of support, the state could support research about the 
effectiveness of California’s preparation and professional development opportunities for 
educational leaders. By using funds mentioned above, this research could help identify 
promising approaches to leaders’ learning, including how best to support leaders from different 
geographic regions, experience levels, and racial and ethnic groups. 
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2. Align the content and structure of professional learning opportunities to the 
identified needs of California’s school leaders, with an emphasis on peer-to-peer interactions, 
networks, and mentoring. Professional learning opportunities should be responsive to the 
needs identified by California’s educational leaders. As described in Figure 7, California 
principals report wanting more professional development in areas such as 


e redesigning school structures to support deeper learning; 

e leading instruction that focuses on higher order thinking skills; 

e using discipline for restorative justice purposes; 

e supporting student social and emotional development and physical and mental health; 
e leading schoolwide change processes to improve student achievement; 

e using data to inform continuous school improvement; 

e equitably serving all students; 

e supporting students with disabilities; and 

e leading professional learning for teachers and other school staff. 


These needs expressed by California’s school leaders through survey results are 
consistent with the overall goals of California’s new school accountability and continuous 
improvement system. The system emphasizes a broader set of student outcomes and other 
measures of school success and, through the mechanism of local control, places far greater 
demands on California’s school and district leaders to identify what and how to improve. 


The structure of professional learning opportunities is also critically important. 
California’s school leaders identify the three following types of professional development as 
being most helpful (see Table 7): 


1. Receiving peer observation and/or coaching in which principals have an opportunity to 
visit with other principals for sharing practice 

2. Participating in a principal network 

3. Being mentored and/or coached by an experienced principal as part of a formal 
arrangement 


Research also points to these as key elements of effective professional development programs 
for school leaders. *77 


At the state level, the emerging statewide system of support should emphasize these 
types of professional learning opportunities for school and district leaders. The professional 
learning networks administered by the CCEE may provide one opportunity for building out 
professional learning networks focused on school leadership. 


Most principals in our survey and all superintendents in our focus groups who had a 
mentor or coach emphasized their value. ACSA provides a mentoring program for principals and 
superintendents. Participants are education leaders who are in the first or second year of their 
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position, and they are paired with an experienced mentor who provides confidential support. 
California could build on and expand ACSA’s model so it is available to all school and district 
leaders throughout the state. 


Districts might also increase their funding for principal and superintendent networking 
and coaching opportunities. Again, most principals and all the superintendents in our focus 
groups described the important role of formal and informal networks in their learning. Districts 
could help cover the cost of travel and related expenses for education leaders to participate in 
networks. In addition, districts could provide support to leaders’ schools and districts in their 
absence so that principals and superintendents have the time and space to participate in on- 
the-job learning opportunities. 


3. Ensure that all novice school leaders have access to a high-quality and affordable 
induction program through strategic programmatic support. Like many states, California 
requires all new administrators to complete a 2-year, job-embedded administrator induction 
program in order to earn a clear administrative credential. A key component of the induction 
program is on-the-job coaching from a trained and experienced coach. Multiple studies find 
that programs that include mentoring and coaching for principals are associated with increases 
in principal effectiveness and retention.’ In the past, dedicated state funding through AB 75 
(2001) and AB 430 (2006) supported the costs of induction. With flexibility in funding under 
LCFF, some districts continue to provide induction for new administrators using LCFF funds, but 
others do not. As a result, many administrators are now paying for induction out of pocket and 
experience inconsistency in access to this type of support. For example, in our survey, only 
three quarters of California principals (77%) in their first and second year received mentoring 
and coaching. It’s worth noting that the quality of these arrangements varied, and only 43% of 
first- and second-year principals reported having a formal on-the-job mentor or coach with 
whom they met at least once a month. Our findings that California principals tend to have less 
experience than principals in many other states, as well as high rates of turnover, point to a 
need for increased investments in mentoring and support for new administrators. 


California took an important first step in supporting greater access to induction 
programs in 2015, when the Legislature allocated $490 million to support professional learning 
for educators, with mentoring and induction for both teachers and leaders among the 
allowable uses of these funds. This could be viewed as a down payment on the state’s 
investment in professional learning for California’s educators, though it remains to be seen how 
much, if any, of these funds were allocated to school leaders. The 2017 state budget included a 
modest investment of approximately $6.5 million in the development of school leaders through 
the CalEd competitive grant program (with an additional $2.7 million for the recruitment and 
retention of teachers).’*? Demand for this funding far exceeded supply, with 79 applications 
submitted requesting over $72 million in total funding, and just 32 proposals funded. 


In short, districts across the state have evidenced a strong need for increased 
investments in induction and other professional learning opportunities for their school leaders. 
Moreover, the state and districts should ensure that mentoring and induction programs include 
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the research-based elements of high-quality programs, such as ensuring that coaches and 
mentors are former exemplary administrators and that they are trained to be successful in their 
role.‘*4 The state should also consider how to best address the challenges of providing high- 
quality mentoring and induction programs to educational leaders located in remote rural 
communities. 


Preparation 


4. Stay the course to strengthen and streamline California’s licensure and 
accreditation system for school administrators, including implementation of California’s new 
administrator performance assessment. Over the past several years, the California CTC has 
made significant reforms to California’s system for preparing school leaders, including the 
standards aspiring school leaders must meet to earn their preliminary administrative credential 
and the standards that administrator preparation programs must meet to operate in the state. 
Although we cannot identify causality, strong results from recent program completers suggest 
California could be starting to strengthen the preparation system for aspiring principals. We 
recommend that these reforms be given sufficient time to take hold, noting that the vast 
majority of findings in our survey reflect the experiences of many California school leaders who 
were prepared under prior requirements. 


As discussed above, California’s new standards— known as the California Professional 
Standards for Education Leaders’? (CPSEL), which apply to practicing administrators, and the 
California Administrator Performance Expectations’”° (CAPE), which apply to administrator 
candidates—define what California school leaders should know and be able to do. They include 
a stronger focus on instructional leadership as well as on creating school environments that 
support the whole child, including a child’s social, emotional, physical, and academic 
development. These changes are consistent with the areas in which survey respondents said 
they lacked sufficient preparation. In 2013, California also implemented a new requirement 
that all candidates for the administrative credential must have at least 5 years of teaching or 
other related experience (e.g., school counseling)—up from the prior requirement of 3 years. 
This change may also increase new administrators’ confidence in providing instructional 
leadership. 


Perhaps most importantly, as described above, California is in the midst of 
implementing a new administrator performance assessment, which all administrator 
candidates must pass in order to earn their preliminary administrative services credential. 
When fully implemented during the 2019-20 school year, *”’ this assessment will require 
administrative credential candidates to demonstrate their leadership knowledge and skills 
through three authentic tasks completed during the candidate’s school site placement during 
their administrator preparation program. In short, California is a leader among states in 
ensuring that aspiring administrators actually demonstrate competency with core school leader 
responsibilities before earning their license. 


5. Build a robust pipeline of qualified and committed school principals through service 
scholarships and residency programs for school leaders. California can provide financial 
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support to develop pipelines of qualified school and district leaders through service 
scholarships and residency programs. The California superintendents in our focus groups most 
frequently reported that the most significant barrier to finding quality school leaders was 
limited resources for developing pipeline programs that find teachers with leadership potential 
and help them along the pathway to becoming a principal. 


To create a robust pipeline of qualified principals, the state and districts could provide 
funding for internships or residencies for principal candidates, in which candidates work under 
the guidance of expert principals so they can experience the daily demands of school leaders 
with the support of an experienced school leader who can model strategies and coach them. 
Some states and districts provide financial support for internship and residency programs so 
that principals can enter the profession feeling more competent and confident about their 
responsibilities. For example, Tennessee recently provided funding in high-need districts for 
leadership residency programs that give a full year of training for candidates working directly 
with an expert leader and tightly connected to their preparation coursework.’ In Illinois, 
Chicago Public Schools provides financial support for preparation programs to offer funded, 
yearlong residencies to aspiring principals in the district.’?? Such residencies can be funded in 
part by placing candidates in schools as assistant principals. 


New Leaders’ Aspiring Principals Preparation Program is another model in California of 
an effective residency program. Participants in the program complete a yearlong residency in 
which they work alongside mentor principals. The residency is designed to expose candidates to 
the day-to-day realities of a principalship as well as problem-based learning opportunities such 
as role-playing and simulations, while providing feedback, support, and coaching. Local districts 
and philanthropic organizations help to fund the residencies. During the residency, candidates 
pay no fees for the program and receive a full salary from the partner district they are working 
in. New Leaders attracts highly qualified and diverse individuals, many of whom are 
recommended by their districts to participate in the program. Principals who complete the New 
Leaders residency program tend to lead schools in which students experience larger gains in 
their achievement than schools led by non-New Leaders principals, controlling for student 
characteristics. ‘°° In addition, New Leaders-trained principals are more likely to remain in their 
schools for 3 or more years, compared to other newly placed principals. 72" 


California could offer grant funding and technical assistance for competitive service 
scholarship programs for principal preparation programs to attract exemplary candidates to the 
field and allow them to participate in internships with expert principals—a key feature of 
effective programs. For example, the North Carolina Principal Fellows Program offers $20,000 
annually in scholarship loans to attract outstanding aspiring principals. The program includes 2 
years of preparation that encompass both coursework and a yearlong, full-time internship 
under the mentorship of an expert principal. In exchange, principal candidates agree to 4 years 
of service as a principal or assistant principal in one of the state’s public schools. Since its 
inception in 1993, the program has trained more than 1,200 principal fellows. As of 2007, more 
than 12% of the state’s principals and assistant principals were graduates of the program. One 
study found that North Carolina Principal Fellows score higher on licensure exams; are more 
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likely to be hired for a school leader position; and, once placed, are at least as effective as other 
graduates of the University of North Carolina Master of School Administration program, with 
more positive impacts on student absences, teacher turnover, and school working 
conditions. *°” 


Even without state investments in robust pipeline programs, California districts can 
invest locally in such a program, as Long Beach Unified School District (LBUSD) has done. The 
district has a “Grow Your Own” leadership development pipeline consisting of eight programs 
aiming to recruit, train, support, and retain high-quality leaders. These programs include a 
series of workshops preparing teacher leaders to become assistant principals; shadowing and 
professional development programs for aspiring principals; on-the-job coaching and support 
meetings for principals in their first 2 years; and continued coaching for principals with 3 or 
more years of experience.’*? The costs of the program vary based on stage and are typically 
shared by the district and candidate. For example, new LBUSD principals participating in the 
Clear Administrative Credential Program pay half of the 2-year total $7,000 cost of the program, 
and LBUSD pays the other half. The pipeline in Long Beach is a promising model. For example, 
92% of Long Beach principals used to be teachers in the district, and 92% of new principal hires 
are still in the district after 5 years. *°* 


Conclusion 


Improving student achievement in California requires strong school and district 
leadership. However, investing in the growth of educational leaders is one of the most 
overlooked courses of action for raising student outcomes. Providing quality preparation and 
professional development opportunities is critical for strengthening California’s educational 
leadership. High-quality preparation and professional learning opportunities help school and 
district leaders implement the more recent education initiatives in the state that help advance 
more meaningful 21st-century learning. 


The results from this study can guide policymakers’ investments in California’s 
educational leaders. Although many principals received various elements of strong preparation 
and professional development, few received comprehensive preparation or professional 
development opportunities, and nearly all report they want more support for their learning. 
The piecemeal nature of California’s learning system for principals and superintendents leaves 
many leaders without some of the most valuable elements of quality learning experiences and 
with a limited understanding of how to lead schools and districts that support deep learning 
and address the needs of the whole child. 


Other states have proven that investments in education leaders’ learning can be a cost- 
effective way to improve student outcomes. California should continue to build on its efforts to 
improve administrator preparation and consider developing a statewide system of ongoing 
learning supports for principals and superintendents. These investments are critical to the 
future success of the next generation of Californians. 
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Appendix A: Methodology 


To conduct this study, the Learning Policy Institute analyzed secondary data sets, 
surveyed a representative sample of principals, and conducted focus groups and interviews 
with educational leaders. 


Secondary Analyses of Data Sets 


To analyze national trends, we primarily leveraged the federal Schools and Staffing 
Survey (SASS). The SASS database—which samples school principals and teachers to allow state- 
level estimates—includes questions on principal preparation, principals’ past experiences, and 
principal professional development. Moreover, because the data set includes a longitudinal 
component, it allowed us to assess the proportion of principals who remain at their school from 
one year to the next. Although the survey is national (7,512 school leaders), the California 
subsample (433 school leaders) was sufficiently large to allow us to conduct a robust analysis. 
We received the restricted-use SASS data files, Principal Survey, Principal Follow-Up Survey, and 
District Survey from the National Center for Education Statistics. We mainly relied on the 2011- 
12 data, but we also used the SASS 2003-04 and SASS 2007-08 to provide context over time. 


Focus Group and Interviews 


We conducted three focus groups of current California superintendents, one focus 
group of current principals, and interviews with former principals to better understand the 
factors influencing the supply and demand of school leaders, and their workforce entry and exit 
decisions, as well as to learn about the current preparation and support leaders receive. To 
supplement the focus groups, we administered an approximately 10-minute survey about the 
factors that influence leaders’ career decisions. The ACSA identified individuals from across the 
state representing a range of schools and districts in terms of size and socioeconomic 
conditions. The focus groups included 15 superintendents, six principals, and three former 
principals who left for nonretirement reasons. The focus groups and interviews were conducted 
between November 2017 and January 2018. 


The focus groups and interviews were recorded and transcribed. We used Dedoose 
coding software to identify emphasized topics and emergent themes. We also analyzed the 
survey results from the focus group and interview participants by producing basic frequency 
distributions and means for responses to each of the questions asked. After that, we continued 
to refine our analysis through an iterative process of comparing the focus group and interview 
results, the survey, and national data. 


Representative Survey of California Principals 


In April 2017, the Learning Policy Institute and ACSA contracted with American Institutes 
for Research (AIR) to administer the Survey of California Principals. In May 2017, AIR launched 
the survey using an online administration platform. 
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Study population and sampling frame. The sampling frame was constructed using the 
U.S. Department of Education’s 2014-15 Common Core of Data (CCD).**° The frame was 
augmented with additional information from the current California Public School Directory 
(PSD) provided by the California Department of Education.**° In an effort to lower costs, each 
principal from the PSD was matched with records from the ACSA membership database to 
identify high-probability respondents (ACSA members, defined as principals from schools in 
which the name in the PSD matches the record in the ACSA membership database). 


Eligibility. Schools eligible for this study were regular public primary, middle, and high 
schools with active student enrollment in the 2014—2015 school year, as reported in the CCD. 
Schools without any enrolled students; homebound and hospital schools; +?” detention, 
corrections, and treatment centers;'?® and nonregular schools+?9 were not eligible for the 
study. 


There were 10,508 California public schools on the CCD for school year 2014-15. After 
removing the noneligible school types specified above, the number of schools available for 
sampling totaled 8,649, with 3,612 (41.8%) of them matched using the ACSA database. 


Sampling design and sampling results. The final sampling frame was first stratified by 
ACSA membership and school level—two variables that are key to the study design. The schools 
matched by the ACSA were oversampled by a factor of 2, which means schools whose principals 
are ACSA members had a chance of being selected that was twice that of schools whose 
principals are not ACSA members. Sampling weights were created to compensate for the 
differential selection probabilities so that the weighted results are representative of the target 
school population. In total, 900 schools were sampled for the study. As a result of oversampling 
the schools whose principals are ACSA members, 59.0% of sampled schools are schools whose 
principals are ACSA members, although this group of schools only makes up of 41.8% of the 
target school population. 


Table A1 shows the distribution of schools in each category of sorting variables for the 
frame and the sample. As expected, the distributions of the population and the sample across 
different levels of sorting variables resemble each other, with small differences due to sampling 
variation. 
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Table A1. Percentage of Sampled Schools in Each Category of Sorting Variables for the 
Frame and the Sample 


School characteristics Frame (N=8,649) Sample (n=900) 
Percentage of student enrollment eligible for free and reduced-price lunch 
Low 49.9 50.0 
High 49.9 49.8 
Missing 0.1 0.2 
Percentage of White, non-Hispanic student enrollment 
Low 50.0 50.1 
High 50.0 49.9 
School enrollment 
Low 50.1 48.9 
High 49.9 51.1 
Urbanicity 
Urban 40.6 40.1 
Suburban 41.2 42.3 
Town 7.2 7.3 
Rural 11.0 10.2 
Missing # 0.0 


Notes: Detail may not sum to totals because of rounding. 

# Rounds to zero. 
Source: U.S. Department of Education, National Center for Education Statistics, Common Core of Data, Public 
Elementary/Secondary School Universe Survey, 2014-15. 


Nonresponse bias analysis. The study contacted principals of the 900 sampled schools 
to participate in the survey. Among the 900 schools, one was closed and thus ineligible; 
principals at 462 schools provided sufficient data to be classified as responding schools; and 437 
principals did not respond and were classified as nonresponding schools. The unweighted 
survey response rate is 51.4% (number of responding schools divided by all eligible schools, 
which include all responding schools and nonresponding schools). 


Because about half of the sampled schools did not respond to the survey, there might 
be nonresponse bias in the resulting data if the variables of interest correlate with the response 
propensity (i.e., those who responded might have answered the questions differently than 
those who did not respond). 


Because information on the variables of interest was not available for nonrespondents, 
the sample design variables available on the sampling frame were used to assess the 
nonresponse bias. As shown in Table A2, the distributions on school level; percentage of 
student enrollment eligible for free and reduced-price lunch; percentage of White, non- 
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Hispanic student enrollment; and school enrollment look similar between the selected sample 
and the responding sample, meaning that the response behavior did not correlate with these 
school characteristics. However, the schools whose principals were ACSA members were more 
likely to respond than those whose principals were not (p < 0.05), and urban schools were less 
likely to respond than nonurban schools (p < 0.10). 


Table A2. Percentage of Schools by Stratifying and Sorting Variables for the Selected and 
Responding School Samples 


School characteristics Selected (n=899) Responding (n=462) 
ACSA membership* 

Yes 59.1 62.6 

No 40.9 37.4 
School level 

Primary 67.1 65.6 

Middle 16.0 15.6 

High 14.5 16.7 

Combined 2.4 2.2 
Percentage of student enrollment eligible for free and reduced-price lunch 

Low 50.1 51.5 

High 49.9 48.5 
Percentage of White, non-Hispanic student enrollment 

Low 50.2 48.5 

High 49.8 51.5 
School enrollment 

Low 48.9 50.6 

High 51.1 49.4 
Urbanicity* 

Urban 40.0 36.1 

Suburban 42.4 43.9 

Town 7.3 8.7 

Rural 10.2 11.3 


Notes: Detail may not sum to totals because of rounding. 

* Statistically significant at the .05 level in the chi-square test. 

Tt Statistically significant at the .10 level in the chi-square test. 
Source: U.S. Department of Education, National Center for Education Statistics, Common Core of Data (CCD), 
Public Elementary/Secondary School Universe Survey, 2014-15. 
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Weighting. After applying the nonresponse adjusting factor to the sampling weight of 
the respondent, the nonresponse-adjusted weights were raked so that the sum of final weights 
matched the marginal totals of each variable used in the raking process for the sampling frame. 
All design variables as shown in Table 4 were used in the raking process. Table A3 shows the 
distribution of schools in each category of design variables for the frame and the unweighted 
and weighted responding sample. As expected, the distributions of the population and the 
responding sample across different levels of design variables resemble each other after 
weighting the data by nonresponse-adjusted weights and match exactly after weighting the 
data by the final weights. 
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Table A3. Percentage of Schools by Stratifying and Sorting Variables for the Frame and the 
Responding Sample 


Responding sample (n=462) 


Weighted by 
Frame nonresponse- Weighted by 
AYol sYoto) Moller telat d (ot) (8,648) Unweighted adjusted weights final weights 

ACSA membership 

Yes 41.8 62.6 41.8 41.8 

No 58.2 37.4 58.2 58.2 
School level 

Primary 66.2 65.6 65.0 64.7 

Middle 15.9 15.6 15.9 16.0 

High 14.7 16.7 16.4 16.7 

Combined 3.2 2.2 2.7 2.7 
Percentage of student enrollment eligible for free and reduced-price lunch 

Low 50.0 51.5 52.0 50.0 

High 50.0 48.5 48.0 50.0 
Percentage of White, non-Hispanic student enrollment 

Low 50.0 48.5 48.4 50.0 

High 50.0 51.5 51.6 50.0 
School enrollment 

Low 50.1 50.6 51.0 50.1 

High 49.9 49.4 49.0 49.9 
Urbanicity 

Urban 40.6 36.1 40.3 40.6 

Suburban 41.1 43.9 41.7 41.1 

Town 7.3 8.7 6.8 7.3 

Rural 11.0 11.3 11.1 11.0 


Note: Detail may not sum to totals because of rounding. 
Source: U.S. Department of Education, National Center for Education Statistics, Common Core of Data (CCD), 
Public Elementary/Secondary School Universe Survey, 2014-15. 
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Survey mode and content. The Survey of California Principals was sent to 900 principals 
in the state. The English-only survey planned to use one data collection mode (web); AIR also 
prepared a PDF version of the survey instrument to accommodate sample members who 
preferred to complete the survey on paper and was prepared to conduct the survey by 
telephone if a sample member agreed to do so during any telephone contact. There were no 
requests to complete the survey by telephone or for a paper survey. AIR stopped survey 
outreach in July when most schools began summer break. A nonresponse follow-up effort 
occurred in August 2017. During the nonresponse follow-up process, AIR mailed a paper version 
of the survey to sample members who had not submitted a completed survey. AIR revised 
some of the survey items (i.e., updated some questions to reference the 2016-2017 school 
year). Nine respondents completed and returned the paper survey. The project achieved a 
targeted response rate of 51% by September 8, 2017. Once the survey ended, AIR created 
appropriate weights, performed a nonresponse bias analysis, and prepared the data file for LPI. 


Data collection strategy. The key components of data collection included the following: 
(1) a prenotification letter including an unconditional prepaid incentive in the form of a $5 
Amazon.com gift code; (2) an email invitation to participate in the survey, including a direct link 
to the survey; (3) a conditional postpaid incentive in the form of a $15 Amazon.com gift code; (4) 
biweekly email reminders; (5) an early-completion bonus incentive offer in the form of a $10 
Amazon.com gift code; and (6) one telephone reminder call. 


To achieve our targeted response rate of 50% (450 completed surveys), these four 
survey activates were added to our data collection strategy: (1) telephone reminders; (2) 
personalized email reminders from a known sender; (3) postcard reminders; and (4) a bonus 
incentive experiment. Additionally, survey extension activities were performed in the 2017-18 
school year, including (1) additional personalized email reminders from a known sender; (2) 
hard-copy surveys mailed to nonrespondents; and (3) telephone reminders. 


Questionnaire development and testing. The survey was designed to help understand 
California principals’ learning experiences and needs for supporting classrooms focused on 
deeper learning (e.g., implementing new standards, conceptual understanding of content, 
problem solving and research skills, and social and emotional development); developing adults 
as members of an instructional team; redesigning school organizations to better support 
student and adult learning and community connections; and managing change. The survey 
covers both principal preparation and professional development experiences as well as career 
satisfaction and plans to leave or stay in the profession. 


The questionnaire is based on a survey initially administered by Darling-Hammond et. al. 
(2010), which was funded by the Wallace Foundation and used in the book Preparing Principals 
for a Changing World: Lessons From Effective School Leadership Programs. After adding 
additional items that specifically focused on deeper learning and social and emotional learning, 
as well as questions specific to California’s education landscape, LPI conducted cognitive 
interviews to help determine how well respondents are able to understand the items, retrieve 
and use information required for developing an answer, and finally select and report an answer. 
LPI and AIR revised the questionnaire based on feedback from the cognitive survey and 
formatted the survey for online and hard-copy applications. 
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Appendix B: Survey Results 


Table B1. California Principals’ Leadership Preparation Program Experiences 


To what extent did your leadership KON MolCom cole m (-¥-1e(-Letall e) 
preparation program emphasize the preparation program prepare you 


following? to do the following? 


ovo 
ica & 
oOo 
a || = 2 | 2 # = ca = 
so | & = 3 © 8 & vu 
i e¢ a E¢) we a. = = _ = 
as ‘3 is f= eel es = fe) o oO = 
Characteristic = oe 8 Qi | 2 & = & z = a 
Problem-based learning approaches, such as 
Bape : 4% | 11% | 17% | 35% | 34% 


action research or inquiry projects 


Field-based projects in which you applied 
ideas from your coursework to your 3% 8% 13% 34% 41% 
experience in the field 


A student cohort—a defined group of 
individuals who began the program together 11% 6% 9% 14% 60% 
and stayed together throughout their courses 


Instructional leadership focused on how to 


9 9 9 9 9 9 fe) 0, 9 0, 
develop students’ higher order thinking skills ae ae on oe on aus a a aon 1s 


Instructional leadership focused on raising 


9 9 fe) fe) 9 9 0, 0, fe) 9 
schoolwide achievement on standardized tests ue zn aun ane aan au 8 ae ai i 


Select effective curriculum strategies and 


; 9% 14% 27% 32% 17% 3% 17% 38% 29% 13% 
materials 


Lead instruction that supports implementation 


: ; 19% 13% 22% 27% 19% 9% 17% 32% 30% 12% 
of new California state standards 


Use student and school data to inform 


: : 5% 10% 22% 36% 28% 3% 10% 33% 36% 18% 
continuous school improvement 


Lead a schoolwide change process to improve 


; 3% 10% 18% 36% 33% 3% 12% 27% 41% 18% 
student achievement 


Engage in self-improvement and your own 


: : 2% 7% 20% 38% 33% 2% 5% 28% 39% 26% 
continuous learning 


Create collegial and collaborative work 


; 1% 6% 23% 40% 31% 0% 5% 35% 37% 23% 
environments 


Work with the school community, parents, 


9 fe) fe) fe) fe) 0, fe) fe) 9 fe) 
educators, and other stakeholders oe af een ree ue On on meni =a ae 


Lead schools that support students from 
diverse ethnic, racial, linguistic, and cultural 1% 5% 24% 36% 34% 2% 9% 31% 39% 19% 
backgrounds 


Lead schools that support students’ social and 


: 5% 12% 31% 33% 19% 2% 19% 35% 32% 12% 
emotional development 
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To what extent did your leadership KONA] MolCom cole) m (-t-1e (lata le) 
preparation program emphasize the preparation program prepare you 


following? to do the following? 


g 
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Develop systems that meet children’s needs 

and support their development in terms of 5% 15% 32% 34% 13% 2% 20% 40% 30% 9% 


physical and mental health 


Create a school environment that develops 
personally and socially responsible young 
people and uses discipline for restorative 
purposes 


8% 17% 27% 33% 15% 5% 19% 33% 30% 14% 


Redesign a school’s organization and structure 
to support deeper learning for teachers and 4% 10% 23% 41% 21% 2% 13% 34% 37% 14% 
students 

Design professional learning opportunities for A% 9% 30% 41% 16% 2% 14% 37% 34% 12% 
teachers and other staff 

Help teachers improve through a cycle of 


p 4% 8% 23% 39% 25% 1% 13% 33% 37% 16% 
observation and feedback 


Recruit and retain teachers and other staff 10% 19% 34% 27% 10% 3% 24% 40% 23% 9% 


Manage school operations efficiently 2% 11% 24% 40% 23% 1% 11% 33% 38% 17% 


Invest resources to support improvements in 


5% 15% 29% 37% 14% 1% 18% 37% 32% 11% 
school performance 


Meet the needs of English learners 3% 15% 29% 39% 15% 2% 17% 40% 31% 10% 
Meet the needs of students with disabilities 2% 15% 29% 40% 14% 3% 18% 39% 30% 10% 
Equitably serve all children 2% 13% 23% 37% 25% 2% 12% 35% 36% 16% 


Source: Learning Policy Institute. (2017). Survey of California Principals. 
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Table B2. California Principals’ Leadership Development Experiences Since August 2015 and 
Percentage Desiring More Professional Development 


Would you 
To what extent h like t 
Seah e Cie ae : sae How well have your leadership 
leadership development receive more : F 
: : development experiences since 
experiences since August 2015 PD related 
s é August 2015 prepared you to do 
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Instructional leadership focused on 
how to develop students’ higher 4% 7% | 21% | 44% | 25% 88% 2% | 11% | 43% | 32% | 13% 


order thinking skills 

Instructional leadership focused on 
raising schoolwide achievement on 2% | 10% | 18% | 44% | 26% 75% 2% | 12% | 41% | 34% | 11% 
standardized tests 

Select effective curriculum strategies 
and materials 

Lead instruction that supports 
implementation of new California 1% 8% 14% | 42% | 35% 79% 1% | 12% | 33% | 40% | 14% 
state standards 

Use student and school data to 


4% | 13% | 24% | 37% | 22% 75% 4% | 14% | 39% | 31% | 12% 


inform continuous school 1% 5% 19% | 44% | 31% 88% 1% 9% 35% | 38% | 17% 
improvement 

Lead a schoolwide change processto | 59, | yo | 9% | 43% | 29% 88% 1% | 11% | 35% | 37% | 16% 
improve student achievement 

ENBaee seit Mnprevelie nt and 3% | 9% | 19% | 42% | 28% 81% 2% | 9% | 35% | 36% | 18% 
your own continuous learning 

Create collegial and collaborative A% 10% | 28% | 34% | 23% 81% 1% 7% | 37% | 30% | 16% 


work environments 

Work with the school community, 
parents, educators, and other 3% 14% | 31% | 32% | 20% 77% 1% 9% | 40% | 38% | 13% 
stakeholders 

Lead schools that support students 
from diverse ethnic, racial, linguistic, 3% 11% | 25% | 38% | 24% 80% 1% 9% | 39% | 38% | 14% 
and cultural backgrounds 

Lead schools that support students’ 


. . 2% 10% | 27% | 36% | 25% 89% 1% | 11% | 43% | 30% | 14% 
social and emotional development 
Develop systems that meet 
enUldfen > Meets and suppor sels 4% | 14% | 32% | 32% | 19% 88% 1% | 17% | 42% | 29% | 11% 


development in terms of physical 
and mental health 
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Would you 


To what extent have your like to P 
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‘ A development experiences since 
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responsible young people and uses 
discipline for restorative purposes 
Redesign a school’s organization and 
structure to support deeper learning 5% 12% | 29% | 37% | 17% 90% 1% | 15% | 40% | 31% | 12% 
for teachers and students 
Design professional learning 


opportunities for teachers and other 7% | 14% | 29% | 30% | 19% 87% 2% | 14% | 42% | 30% | 12% 
staff 
Help teachers improve through a 

7 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 ‘0 
evel of observation and feedback 6% 12% | 27% | 34% | 22% 84% 2% 14% | 38% | 31% | 15% 
ba pe eteaiee ne 18% | 25% | 26% | 23% | 8% 65% 6% | 25% | 39% | 22% | 8% 
Manage school operations efficiently | 13% | 18% | 27% | 29% | 12% 75% 4% | 15% | 42% | 29% | 10% 
Invest resources to support 
improvements in school 13% | 21% | 29% | 27% | 10% 81% 4% | 21% | 39% | 27% | 9% 
performance 
Meet the needs of English learners 2% 9% | 22% | 35% | 32% 82% 1% | 11% | 40% | 31% | 16% 
eee ieee eran a 3% | 12% | 29% | 37% | 19% 84% 2% | 15% | 41% | 30% | 11% 
disabilities 
Equitably serve all children 2% 8% 21% | 43% | 25% 86% 1% 9% | 40% | 34% | 16% 


Source: Learning Policy Institute. (2017). Survey of California Principals. 
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